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■ty  The  Diagnostic  Rhyme  Test  (DRT)  for  intelligibility  or  voice  communica- 
tions systems  has  been  implemented  at  the  Air  Force  Voice  Processing 
Facility,  Hanscom  AFH,  Massachusetts.  This  report  describes  the  recruiting 
and  training  of  listeners  and  the  usage  of  software  lo  score  the  DRT.  In 
addition,  performance  of  the  ln-house  DRT  is  described.  It  is  concluded  that 
the  ln-house  DRT  Is  an  economical  measure  of  intelligibility  that  yields  highly 
reliable  results  and  adequately  discriminates  small  differences  in  intelli - 
gibtllty.  it  is  further  concluded  that  In -house  DRT  results  are  cnmnnr.-ihlo  in 


DO  . 1473  COitiflM  or  ’ MOV  AA  IS  OftSOl  Wt 


- Unclassified 

AtCu»|Tv  UL  ANWC  A1  ION  ;•>«  «••;<«>  A«3E  R\a-»  ft. 


3o?  OSG 


tittfei  taaaaaaama^nk 


Contents 


1.  INTRODUCTION  7 

2.  T1IE  DIAGNOSTIC  RHYME  TEST  8 

2.  1 Introduction  8 

2.2  Usage  8 

2.2  Structure  of  (lie  DRT  9 

2.  MARLY  IN-IIOUSE  DEVELOPMENT  20 

3.  I Rationale  20 

2.2  Scoring  Software  - CSP-30  Implementation  21 

3.3  Listeners  25 

3.4  Conclusions  and  Recommendations  31 

4.  FOLLOW-ON  DEVELOPMENT  32 

4.  1 Optical  Mark  Header  32 

4.2  Program  Usage  35 

4.3  Listeners  4 2 

5.  PF.RFORMANCK  OF  IN-IIOUSK  DRTs  47 

5.  1 Listener  TCliminatlon  47 

5.2  Repeatability  and  Comparability  48 

6.  COST  50 

7.  CONCLUSIONS  AND  RECOMMENDATIONS  50 

REFERENCKS  53 

APPENDIX  A;  Diagnostic  Rhyme  Test  Word  Lists  55 

APPENDIX  H:  Diagnostic  Rhyme  Test  Scoring  Software  and 

Sample  Printout  CSP-30  Implementation  117 


Jjf 


3 


BEST  AVAILABLE  COPY 


Contents 


A PPFND1X  (':  Diagnostic  Rhyme  Test  Scoring  Software  and 
Sample  Printout  PDP-11  Implementation 

APPKNDIX  I):  t'se  of  Listeners  and  Behavioral  Controls  in 

the  In-llouse  Diagnostic  Hhymc  Test  evaluation 


155 


201 


Illustrations 


1.  DPT  Usage  * 

a-d.  DRT  Test  Booklet  13 

3.  Attribute  Tcsted-Word  Pair  Position  18 

4.  Sub -Feature  State  I .oration  in  Test  Booklet  10 

5.  DRT  Scoring  22 

G.  Scatter  Diagram  and  I .incar  Regression  for  Mean  DRT 

Score  as  a Function  of  Repetition  Number  31 

7.  DRT  Test  Booklet  for  Use  With  the  Optical  Mark  Reader  34 

8.  Sample  Decwriter  Output  During  DRT  Scoring  on  PDP-11  37 

0.  Sample  Printout  Resulting  From  DRT  Scoring  on  PDP-11  38 


10.  Mean  DRT  Scores  for  Probe  After  Kliminaling  Outlier  l.isteners 


Tables 

1. 

Available  Master  DRT  Tapes 

10 

2. 

Microphone  Identification  Used  in  Table  1 

n 

3. 

Available  Word  Lists  and  Speakers  (100  scries) 

i t 

1. 

F -4 A Advanced  Airborne  Command  Post  Master  DRT  Tapes 

12 

5. 

K-3A  AW  ACS  Master  DRT  Tapes 

12 

Ga. 

In-house  and  Dynastat  DRT  Scores 

Listening  Session  2,  25  l-'cb  1076 

2G 

fib. 

In -Mouse  and  Dynastat  DRT  Scores 

Listening  Session  3,  4 Mar  1 !»7 6 

27 

6c. 

In-llouse  and  Dynastat  DRT  Scores 

Listening  Session  4,  22  Mar  1076 

27 

7. 

Number  of  DRT  Repetitions  Listeners  Were  Fxpnsod 
to  for  Speaker  CI1 

20 

4 


Tobias 


II.  OUT  Moans  and  Standard  Deviations  Across  Repetitions  Tor 

I'arh  l.istcnorat  Kach  Session  2!) 

Simple  Linear  Regression  Models  for  Itcpetltlon  (X)  and 

DRT  Score  (Y)  for  Kach  Listener  30 

10.  DIIT  Mean  and  Standard  Krror  Across  Listeners  for  l-'ach 

Repetition  for  Klrst  and  Last  Sessions  30 

11.  DRT  Scores  Obtained  by  Dynastat  for  I lie  Vest  Material  Used 

During  In-llonse  Training  Program  In  December  1076 

and  January  1077  43 

12a.  Training  History  for  Listener  3200  45 

12b.  Training  History  for  Listener  5600  45 

12c.  Training  History  Tor  Listener  0557  46 

13a.  Number  of  Times  Listeners'  Score  Was  Two  or  More 

Standard  Deviations  Helow  Dynastat  Score  46 

13b.  Number  of  Times  Listeners'  Score  Was  Three  or  More 

Standard  Deviations  Helow  Dynastat  Score  46 

14.  In-House  and  Dynastat  DRT  Scores  10 


5 


The  Diagnostic  Rhyme  Test  (DRT): 
An  Air  Force  Implementation 


I.  INTRODUCTION 

The  Diagnostic  Rhyme  Test  (DRT)'  for  intelligibility  was  initially  developed 
under  Contract  No.  !•'  1 0 G2M -7 0 -t * -0 1 ft2  for  the  Air  Force  electronic  Systems  Divi- 
sion, Voice  Processing  Laboratory  (formally  part  of  the  Air  Force  Cambridge 
Research  Laboratories,  Data  Sciences  Laboratory).  In  recent  years  the  DRT  has 
emerged  as  a DoD  Standard  for  testing  the  intelligibility  of  voice  communications 
terminals.  This  is  evidenced  by  its  extensive  use  by  the  DoD  Narrowband  Secure 
Voice  Consortium  during  its  FY7f*  and  FY76  Test  and  evaluation  of  candidate 
narrowband  digital  voice  algorithms  for  use  in  the  lOHO's.  The  PRT's  used  by  the 
Consortium  were  evaluated  under  contract  by  Dynastat,  Inc. , Austin,  Texas,  the 
developers  of  the  test.  This  report  documents  the  development  of  an  in-house 
capability  to  administer  and  score  the  DRT. 


(Received  for  publication  lO.lune  1078) 

1.  Voters,  W.  D. , Sharpley,  A.D. , and  llehmsoth,  C.J.  ( 1073)  Research  on 
Diagnostic  Fvaluation  of  Speech  Intelligibility.  A FC R L -7 2 -06fM. 
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2.  Tllr.  DIAGNOSTIC.  KIIYMK  TEST 


2.1  Inlmilm-lHin 

The  l)HT  is  a test  for  Intelligibility  rather  than  user  neeeptance,  nr  quality,  of 
voice  systems.  Although  related,  it  Is  important  to  note  the  distinction  between 
intelligibility  and  quality.  It  is  possible  tor  a voire  system  to  be  perfectly  Intelli- 
gible yet  have  a very  unnatural  sound  or  not  permit  speaker  recognition.  In  such  a 
case  the  system  is  likely  not  to  he  acceptable  to  the  user.  On  the  other  hand,  a 
system  having  poor  intelligibility  will  certainly  be  unacceptable  to  the  user.  Thus, 
a prerequisite  for  user  acceptance  is  high  intelligibility.  The  IJRT  Is  a measure  of 
that  characteristic  of  a voice  system.  The  test  is  structured  in  such  a way  as  to 
allow  a detailed  analysis  of  the  ahility  of  a system  to  reproduce  certain  classes  of 
phonemes.  These  classes  are  categorized  by  the  binary  attributes  VOICING, 
NASALITY,  SUSTENTION,  SIBILATION,  GRAVENESS,  and  COMPACTNESS.  The 
test  provides  a means  of  measuring  the  performance  of  the  voice  system  for  each 
state,  present  or  absent,  of  these  six  attributes  as  well  as  total  intelligibility.  Using 

these  results,  specific  weaknesses  in  the  voice  system  can  be  pinpointed  and  cor- 

2 3 

rected.  This  method  of  diagnostic  analysis  has  been  successfully  used.  ’ 

2.2 

A series  of  master  tape  recordings  have  been  prepared  by  Dvnastat,  Inc.  under 
various  Government  contracts  to  be  used  as  input  speech  material  for  testing  the 
intelligibility  of  the  voice  system  under  consideration.  Each  tape  recording  con- 
sists of  one  or  more  speakers  uttering  a known  randomized  sequence  or  words. 

Each  word  has  been  selected  from  a pair  of  rhyming  words  differing  only  in  the  lead- 
ing consonant.  Figure  1 presents  the  sequence  of  events  for  DRT  usage.  In  order 
to  conduct  a DRT  one  or  more  master  tape  recordings  are  used  as  input  speech 
material  to  the  voice  system  under  test.  The  processed  output  speech  Is  tape 
recorded  for  later  presentation  to  a crew  of  listeners  for  evaluation.  The  listeners' 
task  is  to  determine  which  of  the  rhyming  words  had  been  uttered  by  the  speaker. 
After  all  tape  recordings  processed  by  the  system  under  test  have  been  heard  by  the 
listening  crew,  computer  analysis  of  the  listeners'  responses  takes  place  and  a 
comprehensive  printout  of  the  results  is  provided.  Further  analysis  by  the  user 
can  then  take  place. 

2.  Smith,  C.  P,  (1076)  Comparative  Evaluations  of  Speech  Intelligibility  Perform- 

ance of  Three  Narrowband  Voice  Communications  Methods;  Trtvoc,  Linear 
Prediction  Coding  (LPtJ)  and  Piecewise  Linear  Prediction  Coding  (PLPC) 

ESP'-TB^T-rai. ^ B 

3.  Smith,  C.  P.  (1077)  Intelligibility  Performance  of  Narrowband  Linear  Predictive 

Vocoders  in  the  Presence  of  Hit  Errors,  l-'.SiP- TH-77 -32(1. 


VOICE  PROCESSING 


LISTENER  EVALUATION 


Figure  1.  I)RT  Usage.  The  sequence  of  events 


2.2  Structure  of  I hr  l)RT 

A complete  DHT  consists  of  one  sneaker  uttering  404  words  of  which  2B4  words 
arc  actually  scored.  The  remainder  are  filler  and  experimental  words.  DHT’s  are 
normally  administered  in  half  teats  (I'll!  words)  using  multiple  speakers.  The  com- 
plete list  of  words  used  in  the  DRT  appear  in  Figures  2. i through  2d.  The  l)ol> 
Narrowband  Secure  Voice  Consortium  has  prepared  a set  of  l)H  r master  input  tapes 
using  various  microphones  and  ambient  acoustic  noise  backgrounds.  These  tapes 
are  in  the  possession  of  this  office  and  are  available  for  l)HT  test  ini'.  Table  1 is 
a summary  of  these  tapes.  In  addition,  master  DRT  tapes  as  indicated  in  Tables  2, 
4,  anil  5 are  also  available. 

2.2.1  T1IKT KST  I lOOK I . FT 

Kaeh  listener  who  is  tasked  to  evaluate  a processed  tape  recording  has  before 
him  a four  page  lest  booklet  for  each  speaker  he  will  hear.  The  booklet  is  sufficient 
to  score  one  half  test.  The  booklet  is  slv  ,,,n  in  Figures  2a  through  2d.  The  speech 
material  the  listener  hears  consists  of  222  words  uttered  by  each  speaker.  The 
words  are  one  word  from  each  of  the  word  pairs  in  the  test  booklet.  The  listener 
is  instructed  to  strike  out  the  word  he  thinks  he  hears.  The  booklet  is  structured  so 
that  the  word  pairs  on  Figures  2a  and  2c  are  the  same  but  presented  In  the  reverse 
order.  Similarly,  the  word  pairs  on  Figures  2h  and  2d  are  the  same  but  appear  In 
reverse  order.  In  addition,  the  present  state  of  each  of  the  six  attributes  are  repre- 
sented by  the  left  word  tn  each  column  on  Figures  2a  and  21>  while  the  absent  state 
is  represented  by  the  right  word  In  each  column  on  those  pages.  The  reverse  is 
true  for  Figures  2r  and  2d. 
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Table  I.  Available  Master  DRT  Tapes 


Tape 

l)KT  TAPES 

♦Environ- 

ID 

Speaker  / I, lit 

ment 

B 

m 

S8 

m 

m 

D 

E-l-A 

U.  302A,  CM  30SB,  Rll  310A 

Quiet 

X 

a 

D 

D 

m 

■ 

E-l-H 

JE  30('A , BV  303A,  IX  304A 

II 

X 

I 

D 

X 

K-2-A 

U 302B,  Oil  307A,  Rll  310B 

II 

X 

X 

X 

X 

E-2-B 

JE  30bB,  BV  303B,  I\  312B 

(1 

X 

X 

X 

X 

K-3-A 

M.  301  A,  CH  30SA,  Rll  31 1A 

»l 

X 

X 

X 

X 

E-3-B 

JE  305A,  BV  304A,  PK  312A 

II 

X 

X 

X 

X 

E-4-A 

l.L  301B,  Cll  307B,  P:  31  IB 

X 

X 

X 

X 

E-4-R 

JE  J05B,  BV  304B,  PK  309B 

»» 

X 

X 

X 

X 

E-5-A 

JS  317A,  LS  315A,  MP  314A 

II 

X 

X 

X 

X 

E-5-B 

JS  317B,  l.S  315B,  MP  314B 

II 

X 

X 

X 

X 

E-6-A 

JS  318A.  l.S  316A,  MP  313A 

II 

X 

X 

X 

X 

E-6-B 

JS  31  SB . LS  31bB,  MP  313B 

II 

X 

X 

X 

X 

C-l-A 

Rll  3 ISA,  JE  310A,  CH  314A 

APCP 

X 

X 

X 

G-l-B 

Rll  31  SB.  JE  310B,  Cll  314B 

II 

x 

X 

X 

G-2-A 

Rll  31 7A,  JE  30SA,  CH  313B 

GEL 

X 

X 

X 

C-2-B 

Rll  317R,  IE  304b,  CH  313A 

II 

X 

X 

X 

G-3-A 

Rll  303A,  JE  311A,  CII  315A 

SHIP 

X 

X 

X 

C-3-B 

Rll  J03B,  JE  311B,  CH  315B 

II 

X 

X 

X 

C-4-A 

Rll  304A,  JE  31 2A,  CH  316A, 

JS  305A 

Office 

X 

X 

X 

G-4-B 

Rll  304B,  JE  312B,  CH  316B, 

JS  305B 

II 

X 

X 

X 

♦Environment:  Ambient  Acouitic  Nolle  Simulated  In  e Sound  Room. 
ABCP  - Airborne  Comnuind  Poit 
HEt.  - Helicopter 
SHIP  - Shipboard 


**  See  Table  2 for  microphone  Identification, 


Table  2 Microphone  Identification  Used  in  Table  1. 


1 - Alice  65DA  Dynamic  Microphone 

2 - Western  Kleetric  Tl  Carbon  Microphone 

2 - (irason-Stadler  K7100M  Throat  Microphone 

•1  - (lencrnl  Hadlo  1560-1*5  Ceramic  Studio  Microphone 

5 - Itoanwell  Dynamic  Noise  Cancellinc  Microphone 

6 - Klectrovoice  M-76/AIC  Dynamic  Helicopter  Microphone 


Table  5 Available  Word  I. is*!  ami  Speakers  (100  Series) 


Word  List 

Speaker 

Word  Mat 

Speaker 

102  A 

nv 

108A 

CII 

1020 

!)V 

!08n 

CII 

10.1  A 

nv 

1 1 1 A 

.i  i-: 

103H 

nv 

till) 

.H-: 

104  A 

RO 

1 12  A 

SN 

104M 

HI) 

I 1211 

SN 

105  A 

nn 

1 11 A 

.1 K 

1051) 

It  D 

mn 

.IK 

106A 

HI, 

1 1SA 

SN 

106H 

m. 

1151) 

SN 

107  A 

on 

1 16A 

n l 

1071) 

cn 

HOB 

BL 

I , in  jin  1 1 iiiwwi  j.i  um  1 1 imhw^^wwp  1 1 ii  > immmmmmmmmmmmrnmmmmtm 
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Table  4.  E-4a  Advanced  Airborne  Command  Post  Master  DRT  Tapes 


Tape 

ID 

DRT  Tapes 

Speaker/  List 

Environment 

1 

♦ Microphone 
2 3 4 

5 

S-l-A 

SM 

301A, 

SK  307  A. 

BD 

3 1 1 A 

Quiet 

X 

X 

X 

X 

S-l-R 

IllI 

303A. 

MM  305 A. 

IP 

309A 

Quiet 

X 

X 

X 

X 

S-2-A 

SM 

30  in. 

SK  3070. 

on 

3110 

Quiet 

X 

X 

X 

X 

s-2-n 

111! 

30313, 

MM  30513. 

IP 

3000 

Quiet 

X 

X 

X 

X 

T-l-A 

SM 

302A, 

SK  30BA, 

OD 

3 12A 

E-4A  Noise 

X 

X 

X 

X 

T-i-n 

mi 

304  A. 

MM  30GA, 

IP 

3 10A 

E-4A  Noise 

X 

X 

X 

X 

T-2-A 

SM 

302B, 

SK  3080, 

OD 

re* 

CM 

ec 

E-4A  Noise 

X 

X 

X 

X 

T-2-R 

im 

3040 

MM  3060, 

IP 

3 10B 

E-4A  Noise 

X 

X 

X 

X 

♦ Microphones: 


1 - ALTEC  650A  Dynamic  Microphone 

2 - Roanwell  Confidencer  Microphone  P/N  240100001 
2 - Grason-Stadler  E7300M  Throat  Microphone 

4 - General  Radio  1560-P5  Ceramic  Studio  Microphone 

5 - N'oise  only  - General  Radio  1560-P5 


Table  5.  E-3A  AWACS  Master  DRT  Tapes 


Tape 

ID 

DRT  Tapes 

Speaker/ List 

Environment 

♦Microphone 

1 2 3 4 5 

S-3-A 

CH  301  A.  JE  305A,  SM  300A 

Quiet 

X X X X 

S-3-H 

IP  3030.  MC  307 A,  GM  31 1A 

Quiet 

X X X X 

S-4-  A 

Cll  3010,  JK  3050,  SM  300B 

Quiet 

;;  x x x 

S-4-H 

IP  303 A,  MC  3070.  GM  3I1B 

Quiet 

X X X X 

T-3-A 

CH  302A,  JE  306A,  SM  310A 

E-3A  Noise 

XXX  X 

e** 

1 

w 

1 

IP  304A,  MC  308A,  GM  3120 

E-3A  Noise 

XXX  X 

T-4-A 

CH  3020,  JE  3000.  SM  3100 

E-3A  Noise 

XXX  X 

T -4-0 

IP  3040,  MC  3080,  GM  312A 

E-3A  Noise 

XXX  X 

♦ Microphones: 

1 - ALTEC  650A  Dynamic  Microphone 

2 - 11-335/ A 1C  Headset  Microphone 

3 - Grason-Stadler  K7300M  Throat  Microphone 

4 - General  Radio  1580-P5  Ceramic  Sludlo  Microphone 

5 - Noise  only  - General  Radio  1560-P5 
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Nr. 


DRT  !■' 


(A) 


ROW 


1 

GOB 

- 

BOB 

COOT  - TOOT 

2 

DAUNT 

- 

TAUNT 

BOND  - PONO 

3 

MOOT 

- 

BOOT 

MOAN  - BONE 

4 

SHEET 

- 

CHEAT 

VI LL  - BILL 

5 

JAB 

- 

GAB 

JEST  - GUEST 

6 

POT 

- 

TOT 

FOUGHT  - THOUGHT 

7 

GHOST 

- 

BOAST 

COOP  - POOP 

8 

LIP 

- 

RIP 

LEAP  - REAP 

9 

ZEO 

- 

SAID 

VAST  - FAST 

10 

GNAW 

- 

0 AW 

KNOCK  - DOCK 

11 

SHOES 

- 

CHOOSE 

THOSE  - DOZE 

12 

CHEEP 

- 

KEEP 

SING  - THING 

13 

BANK 

- 

OANK 

MET  - NET 

14 

GOT 

- 

OOT 

CAUGHT  - TAUGHT 

K+ 

LOAD 

- 

ROAD 

LEWO-  RUDE 

16 

DINT 

- 

TINT 

BEAN  - PEEN 

17 

NECK 

- 

OCCK 

MAD  - BAD 

18 

THONG 

- 

TONG 

VOX  - BOX 

19 

CHOO 

- 

COO 

JOE  - GO 

20 

WEED 

- 

REEO 

BIO  - DID 

21 

SHAG 

- 

SAG 

YEN  - Wf IN 

22 

LOT 

- 

ROT 

LAW  -i  RAW 

23 

VOLE 

- 

foal 

ZOO  - SUE 

24 

NIP 

- 

Dl  P 

NEED  - DEED 

25 

FENCE 

- 

PENCE 

THAN  - DAN 

26 

SAW 

- 

THAW 

CHOP  - COP 

27 

POOL 

- 

TOOL 

FORE  - THOR 

28 

YIELO 

- 

WIELO 

HIT  - FIT 

29 

LAP 

- 

RAP 

LEST  - REST 

Do  1 1 / Tl mt 

1 IlJiii’i-  L’  i.  i)HT  T<‘Sl  Booklet 

i:t 


N amt 


4 


ORT  IV  Nr. 


1 

PEST  - TEST 

FAN  - PAN 

2 

VAULT  - FAULT 

JOCK  - CHOCK 

3 

NEWS  - OUES 

NOTE  - DOTE 

4 

VEE  - BEE 

THICK  - TICK 

5 

SANK  - THANK 

CHAIR  - CARE 

6 

W A 0 - ROD 

BONG  - OONG 

7 

SHOW  - SO 

YOU  - RUE 

8 

LID  - RIO 

LEEK  - REEK 

9 

OENSE  - TENSE 

GAFF  - CALF 

10 

MOSS  ~ BOSS 

MOM  - BOMB 

11 

FOO  - POOH 

THOUGH  - DOUGH 

12 

ZEE  - THEE 

JILT  - GILT 

13 

FAD  - THAO 

PENT  - TENT 

14 

HOP  - FOP 

YAWL  - WALL 

I5* 

LOW  - ROW 

LOOT  - ROOT 

16 

GIN  - CHIN 

VEAL  - FEEL 

17 

MENO  - BEND 

NAB  - DAB 

18 

SHAW  - CHAW 

VON  - BON 

19 

JUICE  - GOOSE 

SOLE  - THOLE 

20 

PEEK  - TEAK 

FIN  - THIN 

21 

OAT  - BAT 

KEG  - PEG 

22 

LOCK  - ROCK 

LONG  - WRONG 

23 

GOAT  - COAT 

OUNE  - TUNE 

24 

MIT  - BIT 

MEET  - BEET 

25 

THEN  - OEN 

SHAO  - CHAD 

26 

JAWS  - GAUZE 

JOT  - GOT 

27 

MOON  - NOON 

BOWL  - DOLE 

28 

KEY  - TEA 

OILL  - DILL 

29 

LAMP  - RAMP 

LEND  - REND 

_____  Poll  / Time 

Figure  2b.  DRT  Test  Booklet 
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RT  IV  Nr. 


(C) 


ROW 


1 

B06 

- 

008 

TOOT  - 

COOT 

2 

TAUNT 

- 

DAUNT 

POND  - 

BOND 

3 

BOOT 

- 

MOOT 

BONE  - 

MOAN 

4 

CHEAT 

- 

SHEET 

BILL  - 

VILL 

5 

0 A 8 

- 

JAB 

QUEST  - 

JEST 

6 

TOT 

- 

POT 

THOUGHT- 

FOUGHT 

7 

BOAST 

- 

GHOST 

POOP  - 

COOP 

8 

ft  1 P 

- 

UP 

REAP  - 

LEAP 

9 

S A I 0 

- 

ZED 

FAST  - 

VAST 

10 

DAW 

- 

ONAW 

DOCK  - 

KNOCK 

il 

CHOOSE 

- 

SHOES 

DOZE  - 

THOSE 

12 

KEEP 

- 

CHEEP 

THING  - 

SING 

13 

DANK 

- 

BANK 

NET  - 

MET 

14 

OOT 

- 

OOT 

TAUOHT  - 

CAUGHT 

15+ 

ft  0 AO 

- 

LOAD 

RUOE  - 

I.EWO 

16 

TINT 

- 

DINT 

PEEN  - 

BEAN 

17 

OECK 

- 

NECK 

BAD  - 

MAO 

18 

TONO 

- 

THONO 

BOX  - 

VOX 

19 

COO 

- 

CHOO 

00  - 

JOE 

20 

RE  £0 

- 

WEEO 

DIO  - 

BIO 

21 

8 A 0 

- 

SHAO 

WREN  - 

YEN 

22 

ROT 

- 

LOT 

RAW  - 

LAW 

23 

FOAL 

- 

VOLE 

SUE  - 

ZOO 

24 

OIP 

- 

NIP 

OEEO  - 

NEED 

25 

PENCE 

- 

FENCE 

DAN  - 

THAN 

26 

THAW 

- 

SAW 

COP  - 

CHOP 

27 

TOOL 

- 

POOL 

THOR  - 

FORE 

28 

WIELD 

- 

YIELD 

FIT  - 

HIT 

29 

RAP 

- 

LAP 

REST  - 

LEST 

< 


* 


Ntmt 


Doit/ Tim* 


Figure  2c.  DRT  Tret  Booklet 
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ORT  IV  Nr. 


(0) 


ROW 


1 

TEST  - PEST 

PAN  “ FAN 

■ i. 

2 

FAULT  - VAULT 

CHOCK  - JOCK 

,1 

3 

OUES  - NEWS 

DOTE  - NOTE 

3 

4 

BEE  - VEE 

TICK  - THICK 

j 

5 

THANK  - SANK 

CARE  - CHAIR 

. 

6 

ROO  - WAO 

DONG  - BONG 

7 

SO  - SHOW 

RUE  - YOU 

i 

8 

RIO  - LIO 

REEK  - LEEK 

9 

TENSE  - OENSE 

CALF  - GAFF 

10 

BOSS  - MOSS 

BOMB  - MOM 

i 

11 

POOH  - FOO 

COUGH  -THOUGH 

J 

12 

THEE  - ZEE 

GILT  - JILT 

4 

n 

13 

THAO  - FAO 

TENT  - PENT 

1 

14 

FOP  - HOP 

WALL  - YAWL 

i 

i54 

ROW  - LOW 

ROOT  - LOOT 

16 

CHIN  - 6IN 

FEEL  - VEAL 

17 

BENO  - MEND 

DAB  - NAB 

18 

CHAW  - SHAW 

BON  - VON 

19 

GOOSE  - JUICE 

THOLE  - SOLE 

■ 

* 

20 

TEAK  - PEEK 

THIN  - FIN 

— i 

= 

2i 

BAT  - GAT 

PEG  - KEG 

: 

22 

ROCK  - LOCK 

WRONG  - LONG 

23 

COAT  - GOAT 

TUNE  - DUNE 

: 

24 

BIT  - MIT 

BEET  - MEET 

25 

OE  N - THEN 

CHAD  - SHAD 

26 

GAUZE  - JAWS 

GOT  - JOT 

27 

NOON  - MOON 

DOLE  - BOWL 

28 

TEA  - KEY 

DILL  - GILL 

29 

RAMP  - LAMP 

REND  - LEND 

Nam* 


Do  t • / Tim* 


Figure  2ii.  DHT  J csl  Uooklnt 
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2.  3.  2 THE  MAJOR  ATTRIBUTES 


The  six  attributes  tested  by  the  DRT  are  VOICING,  NASALITY,  SUSTENTION, 
SIBILATION,  GRAVENESS,  and  COMPACTNESS.  Each  of  the  192  word  pairs  in  a 
half-test  has  been  selected  so  that  the  leading  consonant  differs  only  in  the  present 
or  absent  state  of  a single  attribute.  The  particular  attribute  tested  by  each  word 
pair  is  shown  in  Figure  3.  The  1st,  8th,  ISth,  22nd  and  last  words  in  each  column 
are  not  scored.  These  words  are  included  to  allow  time  for  turning  pages,  moving 
to  the  top  of  the  next  column,  and  for  inclusion  of  experimental  words,  A couple 
of  examples  will  serve  to  clarify  this. 

Example  1.  In  Figure  2a,  the  11th  word  pair  in  the  left  hand  column  is  SHOES  - 
CHOOSE.  In  Figure  3,  the  attribute  corresponding  to  the  11th  word  pair  is 
SUSTENTION.  Thus,  the  word  pair  SHOES-CHOOSE  tests  the  attribute  SUSTEN- 
TION. Further,  since  this  word  pair  is  shown  on  the  first  page  of  the  booklet,  the 
leading  consonant  in  SHOES  exhibits  the  nresent  state  of  t lie  attribute  while  the  leading 
consonant  of  the  word  CHOOSE  exhibits  theabsent  state  of  the  attribute,  thus,  SHOES 
represents  a SUSTAINED  consonant  while  CHOOSE  represents  an  ABRUPT  consonant. 

Example  2.  In  Figure  2d,  the  third  word  pair  in  the  right  column  is  DOTE- 
NOTE.  From  Figure  3,  it  can  be  seen  that  this  word  pair  tests  the  attribute 
NASALITY.  Since  this  word  oair  is  shown  on  the  fourth  r>age  of  the  booklet,  we  observe 
that  DOTE  represents  the  absent  state  of  NASALITY  (Non-Nasal)  while  NOTE  repre- 
sents the  present  state  of  NASALITY  (Nasal). 

2,3,3  THE  SUB-FEATURES 

The  following  constraints  were  observed  in  constructing  the  set  of  test  words: 

(a)  Half  of  the  items  designed  to  test  VOICING  are  fricatives;  the  other  half 
are  stop  consonants, 

(b)  Half  of  the  NASALITY  phoneme  pairs  are  grave;  the  rest  acute, 

<c'  Half  of  the  SUSTENTION  items  are  voiced;  hall  unvoiced, 

(d)  Half  of  the  phoneme  pairs  that  test  SIBILATION  are  voiced,  the  remainder 
unvoiced. 

(e)  Half  of  the  GRAVENESS  test  items  are  voiced;  the  other  half  unvoiced, 

(f)  Half  of  the  COMPACTNESS  items  are  voiced;  the  remainder  unvoiced. 
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f;  - - 

Row 

1 

Filler 

Filler 

2 

Voicing 

Voicing 

3 

Nasality 

Nasal  1 ty 

9 

Sustention 

Sustention 

5 

Sibilation 

Sibilation 

6 

Craveness 

Craveness 

7 

Compactness 

Compactness 

?r' 

8 

Experimental 

Experimental 

9 

Voicing 

Voicing 

10 

Nasality 

Nssal lty 

11 

Su8  tent  ion 

Sustention 

12 

Sibilation 

Sibilation 

13 

Craveness 

Craveness 

19 

Compact  ness 

Compactness 

* 

15 

Experimental 

Experimental 

16 

Voicing 

Voicing 

i 

17 

Nasal  1 1 y 

Nasal i tv 

18 

Sustent ion 

Sus  tent i on 

19 

Sibilation 

Sibilation 

20 

Craveness 

Craveness 

21 

Compactness 

Compactness 

- 

22 

Experimental 

Fxperi mental 

1* 

23 

Voicing 

Voicing 

29 

Naaaliry 

Nasality 

1 

25 

Sustention 

Sustention 

26 

Sibilation 

Sibilation 

27 

Graveness 

Graveneaa 

28 

Compactness 

Compactness 

29 

Experimental 

Experimental 

V 

i 


Figure  3.  Attribute  Tested-Word  Pair  Position 


Figure  4 can  be  used  in  conjunction  with  Figures  2a-d  and  3 lo  determine 
exactly  which  word  pairs  are  presented  with  the  sub-leatures  indicated  above,  A 
plus  <+)  in  Figure  4,  indicates  that  the  two  words  exhibit  the  p-°sent  state  of  the 
sub-feature;  a minus  (-)  the  absent  state.  The  sub-feature  assignments  are  the 
same  for  pages  1 and  3 of  the  DRT  test  booklet  as  well  as  for  pages  2 and  4. 

The  columns  of  pluses  and  minuses  in  Figure  4,  correspond  to  the  columns  of  word 
pairs  in  the  DRT  test  booklet.  Notice  that  in  Figure  3 each  major  attribute  is 
tested  four  times  in  each  column.  Thus,  there  are  four  pluses  and  minuses  in  each 
column  for  each  major  attribute  in  Figure  4.  The  following  examples  will  serve  to 
illustrate  the  use  of  Figures  2a-d,  3.  and  4 to  determine  the  major  attribute  and 
sub -feature  of  each  word  pair. 


Page  No. 

VOICING 

NASALITY  SUSTENTION  SIBILATION 

GRAVE  NESS 

COMPACTNESS 



+ + - + 

f + 

- . 

+ - 

+ + 

- - - + 

„ _ 

+ + 

+ - 

1&3 

- . 

• + - + 

- + 

+ + 

- + 

+ + 

- - - + 

- - 

— 

+ - 

+ + 

- - + - 

_ _ 

+ + 

- + 

- - 

+ + - * 

+ + 

- . 

- + 

2&4 

+ + 

+ - - H- 

+ - 

- - 

+ - 

” • 

+ + + - 

4-  4- 

+ + 

• + 

Main  Attribute 

Sub-Feature  (+/-) 

Voicing 

Frlct Iona  1 /Non-Frtc clonal 

Nasal Itv 

Grave/Acute 

Sustention 

Vo Iced /Unvoiced 

Sibilation 

Voiced/Unvoiced 

Graveness 

Vo Iced /Unvoiced 

Compactness 

Vo iced /Unvoiced 

Figure  4,  Sub -Feature  State  Location  in  Test  ilooklet 


Example  1,  The  second  word  pair  shown  on  page  1 of  the  DRT  test  booklet 
(Figure  2a)  in  the  left  column  is  DAUNT -TAUNT.  Figure  3 indicates  that  this  word 
pair  tests  the  attribute  VOICING.  Since  this  word  pair  is  shown  on  page  1,  (Fig- 
ure 2a)  we  conclude  that  DAUNT  represents  the  voiced  case  and  TAUNT  represents 
the  unvoiced  case.  Referring  to  Figure  4,  we  observe  that  the  first  pair  of  words 
in  the  left  hand  column  of  page  1 of  the  DRT  test  booklet  that  tests  the  attribute 
VOICING  exhibit  the  absent  (-)  state  of  the  sub-feature.  That  is,  the  words  DAUNT 
and  TAUNT  are  non -frictional.  The  word  patr  ZED-SAID  shown  on  page  1 (Fig- 
ure 2a'  also  tests  the  VOICING  attribute.  However,  these  words  are  frictional. 
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This  can  be  observed  by  noting  that  they  are  the  second  word  pair  in  the  left  column 
shown  on  page  1 (Figure  2a)  that  tests  the  attribute  VOICING.  Figure  4 indicates 
that  these  two  words  are  frictional  (+), 

Example  2.  The  l?th  word  nair  shown  on  page  4 of  the  DRT  test  booklet  (Figure 
2d)  in  the  right  column  is  DAB-NAB.  From  Figure  3,  we  ascertain  that  this  word  pair 
tests  the  attribute  NASALITY.  Further,  since  this  word  nair  is  shown  in  page  4 (Fig- 
ure 2d),  we  conclude  that  DAB  is  non-nasal  and  NAB  is  nasal.  The  sub-feature  for 
NASALITY  is  grave  ness.  Referring  toFiguredwe  see  that  the  third  word  nair  in  the 
right  column  shown  on  page  4 (Figure  2d)  that  tests  the  attribute  NASALITY  exhibits  the 
absent  (-)  state  of  the  sub  -feature  grave  ness.  Thus  the  leading  consonant  of  the  word 
DAB  us  non-nasal  and  acute  while  the  leading  consonant  of  the  word  NAB  is  nasal  andacute. 

In  contrast,  the  17th  word  pair  in  the  left  column  shown  on  page  4 (Figure  2d)  is  BEND- 
MEND.  This  pair  alsotests  NASALITY,  Figure  4 indicates  that  fhese  words  are  grave  (+). 

2.3.4  THE  WORD  LISTS 

The  words  in  Figures  2a-d  have  been  spoken  by  each  speaker  in  a predeter- 
mined sequence  called  a word  list.  Each  word  list  is  identified  bv  a three  digit 
number  followed  by  the  letter  A or  B.  The  letter  A is  used  to  identify  the  first  half 
of  the  DRT  and  B to  identify  the  second  haif.  Tables  1,  3,  4,  and  5 contain  sum- 
maries of  word  lists  available  and  the  associated  speaker's  initials.  Appendix  A 
contains  the  actual  word  lists. 


3.  EARLY  IN-HOUSE  DEVELOPMENT 

3.1  Rationale 

The  DRT  has  proven  itself  to  be  a useful  diagnostic  tool  for  finding  weaknesses 
in  narrowband  digital  voice  processing  algorithms.  However,  the  cost  of  a DRT 
using  contractor  resources  was  considered  too  high  (approximately  $550.00  for  a 
six  speaker  DRT  in  KY  78)  to  make  it  practical  for  testing  the  many  algorithm 
changes  required  on  a week  to  week  basis.  In  addition,  the  cost  was  too  high  to 
repeat  the  test  for  each  configuration  in  order  to  obtain  estimates  of  measurement 

4 

errors  needed  for  a complete  statistical  analysis  (that  is.  Analysis  of  Variance  ). 

It  was  determined  that  DRTs  could  be  conducted  at  the  Air  Force  Voice  Processing 
Facility,  Hanscom  Air  Force  Base  using  existing  hardware  for  approximately  one- 
tenth  the  contractor  cost,  excluding  the  scoring  software  development  costs.  In- 
house  resources  were  to  be  used  to  develop  the  software. 


4.  Guenther,  W.C.  (1964)  Analysis  of  Variance,  Prentice  - Hall,  Inc.,  Englewood 
; Cliffs,  N.  .1. 

i 
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3.2  Scoring  Software  - CSP-30  Implementation 

The  DRT  scoring  software  was  written  in  FORTRAN  IV  and  implemented  on 
the  CSP-30  High  Speed  Signal  Processor.  Figure  5 shows  flow  charts  of  the 
scoring  programs  as  implemented  on  the  CSP-30.  The  program  listing  and  a 
sample  printout  of  the  test  results  for  a two-speaker,  two-listener  DRT  are  con- 
tained in  Appendix  B. 

3.2.1  PROGRAM  USAGE 

The  scoring  software  as  implemented  on  the  CSP-30  requires  manual  data  entry 
via  the  ADDS  Video  Terminal.  The  program  is  used  as  follows: 

a.  Load  the  32K  FORTRAN  MIOCS. 

b.  Load  the  DRT  Scoring  Program  (Cartridge  Output!. 

c.  Run  at  starting  address  = 0. 

d.  Be  sure  line  printer  is  on-line. 

e.  The  ADDS  terminal  will  display: 

INSERT  150  FT  CARTRIDGE  IN  UPPER  DECK 
I/O  RESET  - CONTINUE. 

Be  sure  the  cartridge  is  write  enabled.  Insert  it  into  the  upper  Tri-Data  deck. 

f.  After  carrying  out  the  above  instructions  the  ADDS  terminal  will  display: 
SYSTEM  UNDER  TEST” 

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS 
Input  up  to  50  ASCII  characters  to  identify  the  system  under  test,  date,  etc. 

g.  ADDS  will  display: 

HOW  MANY  LISTENERS? 

LL 

Input  an  integer  from  1 to  12  in  [2  format. 

h.  ADDS  will  display: 

HOW  MANY  SPEAKERS? 

SS 

Input  an  integer  from  1 to  6 in  12  format. 

i.  For  I = 1 to  the  number  of  listeners  the  ADDS  will  display: 

LISTENER  I NAME 

N N N N N N N N N N N N N N N N N N N N N N N N 
Input  up  to  24  ASCII  characters  to  identify  the  listener. 

The  following  steps  | through  r will  occur  for  each  listener  I and  each  speaker  J: 

j.  ADDS  will  display: 

FOR  LISTENER  I SPEAKER  J 
ENTER  KEY  NUMBER  AND  LETTER 
NN.NL 

Enter  the  word  list  number  in  13  format  followed  by  the  suffix  letter  in  ASCII, 
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k.  If  no  such  key  is  in  the  program  the  ADDS  will  display; 

*+*****NO  KEY  XXXA******* 

where  XXXA  is  the  key  entered;  The  program  will  go  to  step  j above.  If  the  key 
is  a valid  one  in  the  100  series,  the  ADDS  will  display; 

KEY  = XXXA  SPEAKER 
IF  OK  ENTER  0 

where  XXXA  Is  the  key  entered  and  SPEAKER  is  the  speaker  identification  associa- 
ted witli  that  key  as  stored  in  the  program.  However,  if  the  key  entered  is  a 300 
series  key,  the  ADDS  will  display; 

SPEAKER? 

SS 

Enter  two  (2)  ASCII  characters  identifying  the  speaker.  ADDS  will  then  display: 

--  KEY  = XXXA  SPEAKER 
IF  OK  ENTER  0 

If  anything  other  than  0 is' entered  the  program  returns  to  step  j above.  Steps  1 
through  p below  occur  for  each  page,  K=  1,  2,  3,  4 of  the  answer  booklet  (see  Fig- 
ures 2a  through  2d). 

l.  ADDS  will  display: 

FOR  KEY  XXXA  LISTENER  I PAGE  K ENTER  RESPONSE  BY  COLUMNS 
1 = FIRST  WORD  2 = SECOND  WORD 
RRRRRRRRRRRRRRRRRRRRRRRRRRRRR 
For  the  first  column  of  each  word  pair  on  page  K of  listener  I’s  answer  book  enter 
a 1 if  the  first  word  of  the  pair  was  selected  or  a 2 if  the  second  word  was  selected. 
After  the  first  column  has  been  entered  hit  new  line.  Enter  the  second  column  in 
the  same  way. 

m.  ADDS  will  display  a graphic  representation  of  the  first  15  rows  of  the  page 
just  entered.  An  example  is; 


1 

xxxxx 

xxxxx 

2 

xxxxx 

xxxxx 

3 

xxxxx 

xxxxx 

4 

xxxxx 

xxxxx 

5 

xxxxx 

xxxxx 

6 

xxxxxxxxxxxxxx 

xxxxx 

7 

xxxxx 

xxxxx 

8 

xxxxx 

xxxxx 

9 

xxxxx 

xxxxx 

10 

xxxxx 

xxxxx 

11 

xxxxx 

xxxxx 

12 

xxxxxxxxxxxxxx 

xxxxx 

13 

xxxxx 

xxxxx 

14 

xxxxx 

xxxxx 

15 

xxxxx 

xxxxx 

IF 

OK  ENTER  0 

This  allows  you  to  check  for  errors  in  key  punching  the  entries  of  the  first  15  rows. 
Notice  that  rows  6 and  12  in  column  1 contain  X's  in  both  first  and  second  word 
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positions.  This  indicates  tliat  something  other  tlian  I or  2 was  entered  in  tiiose 
positions  and  eorreetions  sliould  be  made. 

n.  If  no  eorreetions  are  needed  enter  0 followed  bv  new  line.  Anythin)*  otiier 
than  0 implies  a eorreetion  is  to  be  made.  ADDS  will  display: 

HOW  AND  COLUMN  TO  CHANGE?  ENTER  000  TO  CHANGE  ENT  lit  K PACK 

line 

Knter  the  i ow  number  in  12  format  followed  by  the  column  number  in  II. 

o.  If  OOP  was  entered  program  will  go  to  step  I above.  If  a row  outside  the 
range  I to  2!*,  other  than  UP,  or  a eotunin  other  than  1 or  2 is  entered,  program 
goes  to  step  n above.  If  row  and  eolumn  are  within  the  speeified  range,  ADDS 
displays; 

NEW  ENTRY” 

It 

Knter  a 1 or  2.  Program  goes  to  step  m above. 

p.  After  eorreetions  to  rows  1 through  tf>  are  made,  rows  16  through  20  are 
displayed  and  correeted.  in  a similar  manner.  (NOTE:  Corrections  to  any  row  ran 
be  trade  regardless  of  the  rows  being  displayed. ) 

*1.  After  all  pages  tor  listener  I,  key  XXXA  have  been  scored,  the  next  speaker 
is  scored  in  the  same  way.  After  ail  speakers  for  listener  I have  been  scored  the 
data  is  output  to  the  cartridge  and  a printout  of  listener  I's  correct  responses  is 
made, 

r.  The  next  listener  is  scored  in  the  same  way. 

s.  After  all  listeners  have  been  scored,  a percent  correct  printout  is  made 
for  each  listener  using  the  transformation 

H -\v 

score  - i— - x (mot 

Where  H - Number  correct 

W Number  incorrect 
T - Total  number  of  items 

t.  A summary  of  all  scores  and  standard  errors  across  listeners  is  then 
printed  (see  Appendix  ID.  Program  stops. 

u.  Load  the  DRT  Scoring  Program  (Cartridge  Input). 

v.  Hun  at  starting  address  » 0, 

w.  ADDS  will  display: 

INSKHT  CARTRIDGE  IN  CPPKR  DECK 

I/O  R ESET- CONTINUE 

Insert  the  cartridge  containlning  the  DRT  data  into  the  upper  Tri-Data  deck.  After 
hitting  I/O  Reset  and  Continue,  the  program  will  execute  as  in  Kigtre  5b.  A com- 
prehensive printout  of  DRT  results  will  be  made  as  shown  in  Appendix  11.  No 
further  interaction  with  the  ADDS  terminal  Is  require.!. 


i 
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*'  was  considered  crucial  to  • * i«-  success  of  the  in-house  l)RT  program  that 
sufficient  numbers  of  listeners  he  recruited  and  that  their  performance  on  the  OUT 
he  consistent.  The  reliability  of  the  OUT  as  a useful  toed  In  measuring  Intclligibll'tv 
so  that  meaningful  comparisons  between  voice  systems  can  he  made  is  dependent  on 
the  repeatability  of  the  scores.  That  is.  If  a particular  OUT  Is  administered  to  a 
crew  of  listeners  at  different  points  in  time,  are  the  results  different”  If  they  are, 
the  credibility  of  tin*  test  is  in  question.  It  has  been  shown  that  I he  OUT  Is  highly 

e 

reliable  in  this  regard  if  a properly  selected  and  trained  listening  crew  is  used. ' 

In  addition,  for  the  in-house  OUT  program  to  he  of  maximum  utility,  Ihe  re- 
sults obtained  should  be  comparable  to  those  obtained  by  others  who  administer  the 
same  test  to  their  listeners.  In  particular,  we  felt  it  essential  that  in-house  DRT 
results  he  comparable  to  those  obtained  bv  Dvnastat,  Inc. 

During  the  period  February -October  157  6,  2'  volunteer  listeners  participated 
in  DRT  tests  to  determine. the  feasibility  of  implementing  an  in-house  l)RT  progi  am. 
The  volunteers  were  recruited  front  the  Ha  ns  com  AFB  community.  They  consisted 
of  t'.S.  Ait  Force  military,  civilian  employees,  military  dependents  and  in-house 
contractor  personnel.  I'ach  listener  was  subjected  to  a pure  tone  audiometric  test 
for  hearing  loss  and  passed  the  requirements  for  an  11-1  profile  as  specified  in 
A I'M  1G0-I  (C5)  Attachment  2,  2 May  1075.  During  the  period  Fchruary-Marrh  1076 
four  listening  sessions  were  conducted.  Shiah  session  was  approximately  two  hours 
in  duration.  From  four  to  seven  listeners  participated  in  each  session.  The  pur- 
pose of  t tils  initial  trial  period  was  to  gain  some  insight  into  the  feasabilitv  of  con- 
ducting in-house  DRTs  and  to  determine  if  comparability  with  contractor  results 
cat;  be  obtained.  A second  trial  period  consisting  of  three  sessions  was  conducted 
in  October  1076.  The  purpose  of  this  trial  prriod  was  to  measure  the  repeatabMitv 
of  scores  for  ir -house  DRTs  and  to  detect  any  significant  learning  trends  when  a 
listener  is  repeatedly  exposed  to  the  same  lest.  Seven  listeners  were  used  during 
this  second  trial  period.  All  hut  two  had  been  used  in  the  previous  tests. 

5.5.1  COM  PAR  ARIDITY 

Tables  6a  to  6c  contain  summaries  cf  .he  results  of  in  house  listening  Sessions 
2,5,  an. I -1  conducted  during  February  and  March  1576  as  well  as  Dvnastat  scores 
for  tlie  same  I'H’I  tapes  The  systems  used  in  the  tests  wore  all  vocoders  at  various 
narrowband  data  rates.  Only  those  scores  for  listeners  who  participated  in  two  or 
more  sessions  are  reported.  Session  1 is  not  included  because  it  served  as  an 
orientation  for  the  listeners.  The  tables  also  include  55  percent  confidence  intervals 


5.  Volers;  W.  I).  (15651  Performance  Evaluation  of  Speech  Processing  Devices  II. 
The  Role  of  Individual  Differences,  ;M- ('ll  D-tifl-Z-l. 
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based  on  the  Dynastat  means  and  standard  errors,  tn  addition,  the  differences 
between  In-house  and  Dynastat  means  are  Included.  Those  In-house  mean  scores 
that  He  outside  the  confidence  Interval  are  marked  with  an  asterisk  (*).  Some 
observations  follow; 

a.  No  attempt  was  made  to  screen  and  eliminate  listeners  for  (he  purpose  of 
improving  in-house  means. 

b.  Of  the  listeners  used  in  this  trial  period  only  two  participated  in  three 
sessions.  All  others  participated  in  two  or  fewer  sessions. 

c.  The  general  tendency  for  tn-iiouse  scores  was  to  approach  Dynastat  scores 
as  listeners  gained  experience.  In  the  second  listening  session  seven  In-house 
means  fell  below  their  confidence  intervals  while  six  fell  below  their  confidence 
intervals  for  Sessions  3 and  4.  The  median  difference  between  in-house  and  Dynastat 
means  Improved  from  -3.  2 to  -2.  05  from  Session  2 to  Session  3.  For  Session  4 

the  median  difference  was  -2.  3. 


Table  6a.  in-House  and  Dynastat  DRT  Scores. 
Listening  Session  2-25  Feb  197  6 


System 

Speaker 

IN -H0USC 

OYNA 

JTAT 

Dirr 

LISTENER 

MEAN 

MCAN 

S.E. 

95'  C.I. 

I* 

D 

a 

D 

1102 

BL 

87.5 

87.5 

66. 5 

76.0 

89.6 

84.4* 

89.6 

1.35 

(06.4,  92.8) 

-5.2 

CH 

B6.5 

C.9,6 

08.5 

84.4 

87.5 

87.3 

09.8 

1.19 

(87.0,  92.6) 

-2.5 

SN 

H2.3 

72.9 

82.3 

76.0 

78.1 

78.3* 

83.5 

1.27 

(80.5,  86.5) 

-5.2 

1103 

BL 

89.6 

82.3 

88.5 

85.4 

87.5 

86.7 

86.6 

1.74 

(82.5,  90.7) 

*0.1 

CH 

91.7 

85.4 

85.4 

87.5 

90.6 

08. 1* 

91.7 

0.88 

(89.6.  93.8) 

-3.6 

SN 

75.0 

74.0 

78.1 

80.2 

75.0 

76.5* 

79.7 

1.04 

(77.2,  82.2) 

-3.2 

1104 

BL 

85.4 

82. 3 

86.5 

85.4 

85.4 

85.0* 

88.3 

1.19 

(86.5,  91.1) 

-3.3 

CH 

93.8 

85.4 

88.5 

85.4 

87.5 

88.1 

90.8 

1.16 

(80.1,  93.5) 

-2.7 

SN 

63.3 

82.3 

81.1 

80.2 

81.3 

81.7 

82.8 

1.55 

(79.1.  86.5) 

-1.1 

1105 

BL 

81.3 

79.2 

03.3 

79.2 

82.3 

31. I* 

84.8 

1.23 

(81.9.  87.7) 

-3.7 

CH 

07.5 

83.3 

83.3 

84.4 

88.5 

85.4 

08.5 

1.67 

(84.6,  92.4  ) 

-3.1 

' SN 

62.3 

76.0 

82.3 

80.2 

74.0 

79.0* 

82.2 

0.80 

(80.3.  84.1) 

-3.7 

a - first  session  for  this  listener, 
b - Second  session  for  this  listener. 
• • Below  9 St  confidence  interval. 
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Table  Ob.  In-llouse  anti  Dynnatnt  DRT  ScorcH. 
Listening  Session  3 - 4 Mar  107 B 


System 

Speaker 

'N-HCUSE 

DYKASV.T 

o:r 

listfnfr 

— 

MEAN 

MEAN 

S.t. 

955  C . I . 

y 

4* 

6 d 

74 

1106 

8L 

82.3 

86.5 

93.3 

80.2 

85.7 

87. H 

1.70 

(83.3,  91.8) 

•2.1 

CM 

88.5 

90.6 

90.6 

83.3 

an.  <• 

91.7 

0.86 

(39.7.  93.7) 

-3.4 

SN 

74.0 

81.3 

91.7 

77.1 

81.5 

82.2 

1.89 

(77.7,  86.7) 

-0.7 

1108 

BL 

‘ 36.5 

86.5 

92.7 

84.4 

88.0 

38.2 

1.69 

(84.2,  92.2) 

-0.2 

CM 

88.5 

95.8 

90.6 

88.5 

90.1* 

91.9 

0.73 

(90.2.  93.6) 

-1.8 

SN 

76.  C 

84.6 

87.5 

82.3 

33.9 

85.9 

1.73 

(81.8,  90.0) 

-2.0 

1110 

61 

86.5 

89.6 

87.5 

86.6 

87.5* 

92.6 

1.05 

(90.1.  95.1) 

-5.1 

CM 

85.4 

87.5 

93.8 

83.3 

87.5* 

93.0 

0.70 

(91.3,  94.7) 

-5.5 

SN 

76.0 

86.5 

82.3 

82.3 

81.8 

83.2 

1.57 

(79.5.  86.9) 

-2.0 

1112 

BL 

86.5 

93.? 

91.7 

8L.5 

90.1* 

92.4 

0.67 

(90.8,  94.0) 

-2.3 

CH 

90.6 

87.5 

92.7 

95.8 

91.7* 

94.8 

1.08 

(92.2.  97.4) 

-3.1 

SN 

85.4 

88.5 

87.5 

84.4 

86.5 

87.0 

1.59 

(83.2,  90.8) 

-0.5 

a - Second  session  for  this  listener. 
* • Below  95*  confidence  Interval. 


Tabic  6c.  In-House  and  Dynastat  DRT  Scores. 
Listening  Session  4-22  Mar  1076 


System 

Speaker 

IN-HOUSE 

DYNAS 

.TAT 

LISTENER 

MEAN 

MEAN 

S.E. 

951  C.l. 

oirr 

l6 

4*> 

5» 

1113 

BL 

90.6 

86.5 

89.6 

85.4 

88.0 

90.1 

0.90 

(88.0,  92.2) 

-2.1 

CH 

92.7 

89.6 

89.6 

91.7 

90.9 

92.2 

0.65 

(90.7,  93.7) 

-1.3 

SN 

80.2 

86.5 

89.6 

83.3 

84.9* 

88.0 

1.15 

(85.3,  90.7) 

-3.1 

1146 

BL 

90.6 

87.5 

88.5 

86.5 

88.3* 

90.8 

0.80 

(88.9,  92.7) 

-2.5 

CH 

92.7 

92.7 

92.7 

92,7 

92.7 

94.8 

0.88 

(92.7,  96.9) 

•2.1 

SN 

81.3 

84.4 

87.5 

86.5 

84.9* 

91.3 

1.16 

(88.6,  94.0) 

-6.4 

1150 

BL 

87.5 

85.4 

96.9 

BS.4 

88.8 

88.4 

0.89 

(86.3,  90.5) 

♦0.4 

CH 

92.7 

90.6 

90.6 

92.7 

91.7* 

94.4 

0.71 

(92.7,  96.1) 

•2.1 

SN 

84.4 

81.3 

85. 4 

86.5 

84.4* 

88.8 

1.14 

(86.1,  91.5) 

•4.4 

1152 

BL 

88.5 

91.7 

94. B 

89.6 

91.2 

92.2 

0.81 

(90.3,  94.1) 

-1.0 

CH 

92.7 

88.5 

B9.6 

88.5 

89.8* 

92.8 

0.80 

(90.9.  94.7) 

-3.0 

SN 

85.4 

83.3 

85.4 

88.5 

85.7 

87.4 

1.05 

(64.9,  89.9) 

-1.7 

a - Second  session  for  this  listener, 
b - Third  station  for  this  listener. 

• - Below  95*  confidence  Interval. 


3.3.2  RFPKATARIUTY 


During  the  three  listening  sessions  in  October  1976  seven  listeners  were  exposed 
repeatedly  to  the  same  DRT  tape.  Speaker  CH  was  used  for  all  repetitions.  Table  7 
contains  a summary  of  the  number  of  repetitions  each  listener  participated  in  for 
each  of  the  three  sessions.  Table  fl  contains  the  mean  and  standard  deviation  across 
repetitions  for  each  listener  for  each  session.  For  those  listeners  that  participated 
in  two  sessions  the  tendency  was  for  the  mean  score  to  rise  slightly  and  the  standard 
deviation  to  decrease.  This  is  what  might  be  expected  from  listeners  who  are  rela- 
tively inexperienced  and  are  still  rising  on  the  "learning  curve."  A simple  linear 
regression  model  was  fitted  to  the  data  for  each  listener  for  each  session.  The 
independent  variable  was  the  repetition  number;  the  dependent  variable  the  DRT 
score.  The  intent  was  to  examine  the  slope  of  the  regression  line  to  determine  if 
a significant  linear  trend  in. the  listeners'  scores  existed.  Tabic  9 contains  the 
intercept  and  slope  for  each  listener  as  well  as  a 95  percent  confidence  interval  for 
the  slope  of  each  line.  The  confidence  interval  did  not  contain  zero  in  only  two  of 
the  twelve  cases.  This  means  that  the  slopes  of  the  remaining  ten  lines  are  not 
significantly  different  from  zero  indicating  no  significant  learning  trend.  Further 
analysis  consisted  of  computing  the  DRT  mean  and  standard  error  across  listeners 
for  each  repetition  during  the  Tirst  and  Inst  listening  sessions.  Table  10  contains 
these  results.  Figure  6 is  a scatter  diagram  of  this  data  and  contains  a linear  re- 
gression line  for  each  session.  The  slope  of  each  of  these  lines  Is  significantly 
different  from  zero,  however,  it  can  be  observed  that  the  rate  or  increase  is  smaller 
for  (he  third  session  than  Tor  the  first  session.  Additionally,  the  standard  errors 
in  Table  10  are  reducing  and  becoming  more  consistent  as  the  listeners  gain  ex- 
perience. Also  included  in  Figure  6 is  a 95  percent  confidence  interval  for  the  mean 
score  for  speaker  Cil  based  on  the  mean  obtained  by  Dynastat  for  the  same  tape 
used  in  our  in-house  sessions.  A reliable  estimate  for  the  standard  error  for  this 
score  is  not  available.  However,  typical  standard  errors  obtained  by  Dynastat  for 
speaker  CH  when  the  mean  is  neai  93.0  are  less  than  1.00.  The  confidence  inter- 
val shown  in  Figure  8 was  constructed  using  an  estimated  standard  error  of  0,75, 

All  in-house  scores  for  the  20  October  197  6 session  lie  within  the  confidence  interval 
as  well  as  four  of  the  last  five  scores  on  6 October  1976, 

The  foregoing  results  led  to  the  conclusion  that  a properly  selected  and  trained 
listening  crew  used  in  an  in-house  program  could  produce  results  that  are  not  only 
repeatable  but  also  comparable  to  those  obtained  by  Dynastat. 
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6 Oct  76 


1?  Oct  76 


20  Oct  76 


listener 

Mean 

5 td  Oev 

Mein 

Std  Oev 

Mem 

Std  Oev 

4 

93.3 

2. .8 

■ 

- 

95.0 

1.25 

8 

96.6 

186 

- 

96.8 

0-63 

9 

92.0 

1.80 

2.05 

• 

- 

91.6 

3.10 

- 

• 

92.9 

1 79 

87.0* 

4 . 00 

92.1 

1.66 

• 

- 

• 

- 

• 

• 

91.7 

1.89 

• 

• 

• 

• 

95.1 

2 . ’9 

•First  exposure  to  the  CRT  for  this  listener 
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Table  9.  Simple  Linear  Regression  Models  for  Repetition  (X)  and  DRT  Score  (Y)  for 
Rach  Listener 


6 OCT  76 

12  OCT  76 

20  OCT  76 

Intercept 

Slope 

95t  C. 1. 
for  Slope 

Intercept 

Slope 

95t  C.l. 
for  Slope 

Intercept 

Slope 

951  C.L 
for  Slope 

4 

92.9 

0.07 

(-0.67,  0.81) 

- 

- 

- 

94.6 

0.09 

(-0.31,  0.49) 

8 

94.1 

0.30 

(-0.25,  0.84) 

- 

- 

• 

96.1 

0.14 

(-0.02.  0.30) 

1 ' 

90.4 

0.33 

(-0.18,  0.84) 

90.2 

0.«9 

(-0.02,  0.99) 

- 

- 

- 

96.9 

0.94* 

(0.37,  1.50) 

- 

- 

* 

90.9 

0.40 

(-0.06,  0.86) 

1 .--V. 

82. 5 

0.90 

(-0.21,  2.01) 

92.8 

-0.16 

(-0.82,  0.50) 

* 

- 

- 

- 

- 

- 

- 

- 

- 

91.2 

0.07 

(-0.29,  0.44) 

Hi 

- 

- 

- 

- 

- 

- 

90.7 

0.71* 

( 0.50,  0.93) 

•Slope  significantly  different  from  .zero. 
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REPETITION  NUMBER 


Figure  6.  Scatter  Diagram  anti  Linear  Regression 
for  Mean  DRT  Score  as  a Function  of  Repetition 
Number 


3.4  Cnnrluakma  anti  Recommendation* 

It  was  concluded  that  the  DRT  scoring  software  as  implemented  on  the  CSP-30 
functioned  properly,  however,  the  manual  entry  of  the  raw  data  was  unsatisfactory. 

A six  speaker,  ten  listener  DRT  required  approximately  two  hours  to  enter  the  data. 
The  CSP-30  is  a single  user  system,  the  primary  function  of  which  is  research  and 
development  of  \oice  algorithms.  To  dedicate  the  CSP-30  to  the  time  required  to 
enter  DRT  data  is  a waste  of  a valuable  resource.  In  addition,  this  method  of  data 
entry  proved  to  be  susceptible  to  key  punch  errors.  It  was  recommended  that  the 
DRT  scoring  software  be  implemented  on  an  existing  in-house  PDP-11  mini -computer. 
It  was  further  recommended  that  an  optical  mark  reader  be  procured  and  interfaced 
to  the  PDP-11  and  that  special  DRT  test  forms  be  designed  so  that  automated  data 
entry  could  be  used  in  the  scoring  procedure. 

It  was  further  concluded  that  a listening  crew  could  be  trained  in-house  to  per- 
form In  a consistent  manner  and  obtain  results  comparable  to  those  obtained  by 
Dynastat.  However,  it  was  considered  unsatisfactory  to  depend  on  volunteer 
listeners.  Our  experience  was  that  it  was  difficult  to  obtain  volunteers  who  were 
wilting  or  able  to  participate  in  DRT  listening  the  number  of  hours  and  frequency 
required  for  them  to  become  consistent,  reliable  listeners.  It  was  recommended 
that  listeners  be  hired  and  that  they  participate  In  listening  tests  a minimum  of 
one -half  day  each  week. 

It  was  further  recommended  that  procedures  be  developed  to  recrutt,  train, 
and  control  the  listeners  and  to  monitor  their  performance.  In  addition,  the 
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development  of  a method  for  screening  and  eliminating  those  listeners  who  are 
unsatisfactory  was  required. 


4.  FOLLOW-ON  DEVELOPMENT 

The  decision  was  made  to  fully  develop  the  in-house  DRT  program.  The 
recommendations  of  Section  3.4  were  adopted  and  implemented.  The  following 
Sections  describe  this  development. 

4.1  Optical  Mark  Reader 

A search  through  several  issues  of  the  Excess  ADP  Equipment  Bulletin  pub- 
lished by  the  Defense  Logistics  Agency,  Cameron  Station,  Alexandria,  VA  22314 
revealed  that  two  <2 ) Decision  Optical  Mark  Readers  (OMR),  model  OMR  6510  were 
listed  as  excess.  Further  investigation  revealed  that  these  readers  were  located 
within  ESD  on  Hanscom  AFB.  Contact  with  the  users  was  immediately  established. 

A review  of  the  OMR  documentation  and  discussions  with  the  users  resulted  in  the 
determination  that  the  OMR  could  easily  be  interfaced  with  our  PDP-11  and  that 
forms  could  be  designed  and  procured  to  satisfy  our  requirements.  A no  cost 
transfer  of  the  OMRs  to  the  Voice  Processing  Facility  was  accomplished.  It  was 
immediately  learned  that  the  interface  hardware  required  was  already  available  in 
our  PDP-11.  All  that  was  required  was  to  plug  an  existing  connector  into  the  OMR. 

4.  1.  1 OMR  TEST  BOOKLETS 

DRT  test  booklets  were  dentgned  and  procured  for  use  with  the  OMR.  Two 
different  test  booklets  were  procured;  one  for  the  100  series  word  lists  (ESD  Form 
36)  and  one  for  the  300  series  word  lists  (ESD  Form  37).  Each  booklet  consists  of 
four  (4)  pages  joined  together  at  the  left  edge  by  a perforated  binding.  This  is 
referred  to  as  a four  part  snapak,  This  allows  the  pages  to  be  separated  so  that 
they  may  be  fed  into  the  OMR.  Figure  7 is  a copy  of  a page  from  one  of  the  booklets. 
The  only  differences  between  this  page  and  other  pages  are  the  words  themselves 
and  the  position  of  the  black  rectangle  in  the  upper  right  hand  corner.  This  rectangle 
is  used  to  indicate  the  booklet  page  number  by  it's  location.  The  listeners  are  re- 
quired to  fill  In  certain  header  information  on  the  first  page  of  each  booklet  before 
the  test  begins  a9  indicated  in  Figure  7,  The  information  is  entered  by  first  writing 
it  in  the  large  boxes  to  t lie  left  of  each  information  block.  The  listeners  then 
blacken  in  the  appropriate  rectangles  using  a No.  2 pencil.  During  the  test  listeners 
strike  through  the  word  of  their  choice  as  before.  After  much  experimentation  It 
was  determined  that  wide,  dark  marks  are  required  over  the  words  for  reliable 
OMR  reading.  A certain  amount  of  practice  was  required  before  the  listeners 
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mastered  the  technique  of  prop' ' ly  marking  the  words.  The  time  required  for  this 
practice  was  minimal  when  compared  to  the  total  listener  training  period.  It  was 
determined  that  the  best  marker  to  use  is  a black  tube-type,  felt-tip  marker, 

Ftderal  Stock  Number  7520-00-973-1059.  These  markers  are  available  in  adequate 
supply  and  if  stored  tip  down  between  Itstening  sessions  have  a reasonable  usable 
life.  Rectangles  in  the  extreme  left  and  right  hand  margins  of  each  test  booklet 
page  are  provided  to  give  the  listener  an  opportunity  to  change  his  answer  by  simply 
marking  through  the  rectangle  closest  to  the  word  pair  to  be  changed.  The  test 
form  pages  measure  8-1/2  in.  X 11  in.  after  separation.  They  were  designed  on  a 
5446  Decision  format  sheet  (54  columns  by  46  rows).  The  forms  were  printed  using 
Pantone  Purple  185  ink  (12  parts  warm  red,  4 parts  rubine  red).  Complete  specifica- 
tions for  the  forms  are  available  in  the  Hanscom  Air  Force  Base,  Central  Base 
Administration  (DA)  office. 

4.1.2  SOFTWARE 

The  software  functions  required  to  interface  the  OMR  to  the  PDP-11  and  provide 
data  that  can  be  used  by  the  DRT  scoring  software  consisted  of; 

a.  An  OMR  driver.  This  function  is  required  to  do  the  necessary  handshaking 
between  the  OMR  and  the  PDP- 1 1 interface  card  ( DC -11)  and  to  send  and  receive 
necessary  status,  control,  and  data  words. 

b.  A page  reader.  This  software  module  is  required  to  store  an  image  of  the 
test  booklet  page  being  read.  It  consists  of  filling  in  a 46  x 54  matrix  of  zeroes 
and  ones.  Each  element  of  the  matrix  corresponds  to  a position  on  the  test  form 
page.  A zero  indicates  no  mark  in  that  position,  a one  indicates  a mark, 

c.  A page  interpreter.  This  module  interprets  the  matrix  of  zeroes  and  ones 
constructed  by  the  page  reader  and  extracts  the  following  information: 

1.  System  ID. 

2.  Listener  ID. 

3.  Word  List  ID. 

4.  Speaker  ID. 

5.  Page  number. 

6.  The  responses.  These  are  stored  in  a similar  manner  as  the 
CSP-30  version. 

These  functions  are  drawn  together  into  a program  called  XXX  on  the  PDP-11  disk 
file.  The  output  of  this  program  is  a disk  file  containing  the  data  described  above, 

In  addition,  a program  called  Xl-'LR  is  used  before  actual  scoring  takes  place. 

This  program  accesses  the  data  file  created  by  XXX  and  creates  a new  file  after 
performing  the  following: 

<1.  Translates  the  XXX  file  into  a new  file  in  the  format  required  for  the 
scoring  program. 
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Figure  7.  :_)RT  Test  Booklet  for  Use  With  the  Optical  Mark 

Reader 

e.  Offers  the  opportunity  to  correct  word  list  identification  that  may  have  been 
entered  incorrectly. 

f.  Permits  the  elimination  of  selected  listeners  from  the  scoring  run. 

g.  Permits  the  elimination  of  selected  speakers  from  the  scoring  run. 

The  final  step  in  the  process  is  the  execution  of  the  scoring  program  itself.  This 
program  is  called  SCORE  and  is  substantially  the  same  as  implemented  on  the 
CSP-30.  The  fundamental  differences  are; 

h.  It  has  been  modified  to  accept  data  from  the  disk  file  rather  than  the  ADDS 
terminal. 

i.  The  printout  of  results  has  been  expanded  to  include  a page  which  consists 
of  a matrix  of  listener/speaker  scores. 

Appendix  C contains  the  listings  for  the  above  described  software  and  an  example 
DRT  printout. 

4.2  Program  Luge 

A step-by-step  procedure  for  using  the  DRT  scoring  software  follows.  It  is 
assumed  that  the  operating  system  is  the  RSX-11M  and  the  user  is  familiar  with  it. 

The  scoring  programs  have  been  written  to  prompt  the  use  by  asking  specific 
questions  and  waiting  for  a reply.  Also,  various  error  messages  are  written  on 
the  Decwriter  when  OMR  read  errors  occur.  Figure  8 is  a copy  of  the  Decwriter 
output  for  a DRT  scoring  run.  The  example  in  Figure  8 is  for  a single  listener  and 
a single  speaker.  Items  marked  with  an  asterisk  (1  are  entered  by  the  user,  Fig- 
ure 9 is  the  resulting  printout  of  the  scoring  process  for  this  example.  Before 
starting  the  procedure  the  test  booklets  should  be  prepared  by  first  a rranging  them 
so  that  the  speakers  are  in  the  same  order  for  each  listener.  It  is  convenient,  but 
not  necessary,  to  arrange  the  speakers  alphabetically  and  the  listeners  numerically. 
Listeners  are  identified  by  the  last  four  digits  of  their  social  security  account  number. 
After  arranging  the  booklets  in  the  desired  order  the  bindings  should  be  removed 
so  that  the  pages  separate: 

a.  Turn  the  OMR  on  and  press  the  feeder  clear  and  reset  buttons. 

b.  Run  program  XXX  and  follow  instructions  printed  on  the  Decwriter.  (See 
Figure  8.  ) 

c.  Enter  date  of  test. 

d.  Enter  up  to  50  ASCII  characters  describing  the  system  tested. 

e.  A disk  write  option  is  then  selected.  If  a 1 is  entered  a disk  file  will  be 
created.  If  0 is  entered  no  file  Is  created.  This  option  is  useful  for  checking  the 
OMR  or  forms  alignment.  See  paragraph  f below.  Normal  operation  is  to  enter  a 1. 

f.  A line  printer  output  option  is  then  selected.  A 0 will  cause  no  line  printer 
output.  A 1 will  cause  a printout  to  be  made  of  the  matrix  of  zeroes  and  ones  for 
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each  test  booklet  page.  This  option  is  selected  when  checking  forms  alignment  and 
OMR  operation.  Normal  procedure  is  to  enter  a 0. 

g.  Follow  instructions  for  entering  the  number  of  listeners  and  speakers  and 
the  system  identification  number. 

h.  Follow  instructions  for  entering  the  word  list  key  and  speaker  identifica- 
tion. This  has  been  added  to  eliminate  the  need  for  the  listeners  to  blacken  in  the 
rectangles  on  their  test  booklets  corresponding  to  this  information.  They  should 
continue  to  write  this  information  in  the  large  boxes  to  the  left  of  the  rectangles. 

i.  After  entering  all  word  list  keys  and  speakers  they  will  be  typed  out  on 
the  Decwriter  for  verification.  Carefully  check  their  accuracy.  If  there  is  an 
error  start  over  by  aborting  XXX.  This  is  accomplished  by  typing  in  C while  holding 
the  CKTL  key  down  followed  by  ABORTXXX  after  the  MCR  prompt.  If  the  word 

list  keys  and  speakers  are  correct  type  in  RESUME  followed  by  a carriage  return. 

j.  At  this  time  the  pages  are  manually  fed  into  the  OMR.  Each  page  should 
be  placed  face  dow-n  on  the  glass  platen  with  the  header  end  of  the  page  against  the 
paper  gate.  After  the  page  is  read  it  is  removed  from  the  platen  and  the  next  page 
placed  in  position.  This  process  is  repeated  until  all  pages  are  read.  After  the 
last  page  is  read  a blank  page  (could  use  reverse  side  of  last  page)  is  placed  on  the 
platen  and  read.  This  will  cause  the  program  to  pause. 

k.  After  the  pause,  if  more  pages  are  to  be  read  in  enter  a 0.  If  the  scoring 
run  is  complete  enter  a 1.  A printout  of  "bad  marks"  is  made  on  the  Decwriter. 
These  numbers  are  the  number  of  listener  responses  not  read  by  the  OMR  for  each 
listener.  This  information  is  used  when  training  new  listeners  to  master  the  tech- 
nique of  using  the  markers  and  to  detect  OMR  read  problems.  After  this  printout, 
XXX  stops. 

l.  Various  error  conditions  can  occur  while  reading  pages  in.  These  may  be 
due  to  the  pages  being  read  in  the  wrong  order,  a page  not  properly  aligned  over 
the  glass  platen,  or  a page  read  in  twice.  Error  messages  are  printed  on  the 
Decwriter  for  each  of  these  conditions.  Simply  correct  the  problem  and  type  in 
RESUME. 

m.  The  next  step  in  the  process  is  to  execute  XFER.  Run  XFER  in  the  usual 
way  (see  Figure  8)  and  follow  instructions. 

n.  The  final  step  is  the  actual  scoring.  Run  SCORE  and  follow  instructions. 

Be  sure  the  line  printer  is  on-line.  The  result  will  be  a disk  file  called  FOR006 
DAT  containing  the  scored  DRT  results.  Output  this  file  to  the  line  printer  using 
PIP  to  obtain  hardcopies. 
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Figure  9.  Sample  Printout  Resulting  From  DRT  Scoring  on  PDP-11  (Cont) 
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100.00 

0’.00 

100,70 

0,00 

100.00 

0l00 

1 

■ 

; 

' 

grave 

1PP.P8 

0,00 

100100 

0.00 

100. 0B 

0,00 

J 

* 

ACUTE 

1RR.RO 

0,0* 

100.00 

0.00 

100,00 

0,00 

1 

i 

SUSTENTION 

ipp'.ee 

0.00 

87,80 

0.00 

03.79 

0,00 

i 

VOICED 

100,00 

0,00 

73.00 

0'.00 

87.90 

0,00 

f 

% 

UNVOICED 

100.00 

0,00 

100.00 

0’.00 

100,00 

0,00 

» 

i 

1 

SIBILATION 

S7.9P 

0'.00 

100,00 

0,00 

03.79 

0,00 

t 

a 

3 

VOICED 

78. 00 

0,00 

100',  00 

0' 00 

07.9* 

0,00 

j 

UNVOXCCO 

IMP. 00 

0,00 

100.00 

0.00 

100,00 

0,00 

.1 

-n 

GRAVENESS 

07.30 

0'.0P 

78,00 

0.00 

0 1 , S 9 

0.00 

1 

VOICED 

78.00 

0,00 

100l*0 

0‘.00 

07.90 

0,00 

' 

UNVOICED 

100.00 

0,00 

00.00 

p’.*0 

73,00 

0,00 

4 

2 

COMPACTNESS 

100.00 

0*.  00 

79.00 

0,00 

*7.90 

0.00 

| 

VOICED 

100.0* 

0.00 

100,00 

0.00 

1P0.00 

0,00 

4 

UNVOICED 

100,00 

0,00 

90.00 

0.00 

73,00 

0,00 

1 

TOTALS 

08.83 

0'.00 

69. AS 

0,00 

00.67 

0'.00 

| 

• MEAN  ■ flp.flj  * 

TOTAL  ort  scorei  • • 

• 3 E '.  • 0,00  • 


4.3  Uilmrri 

4.  3.  1 LIST  UN  KR  BEHAVIORAL  CONTROLS 

A study  was  made  to  determine  those  controls  required  to  minimize  the  effects 
of  listener  behavior  on  the  DHTs  conducted  in-house.  The  study  included  a search 
of  the  applicable  literature  and  a personal  interview  with  Dr.  W.  D.  Voters,  one  of 
the  creators  of  the  DRT.  A report  of  this  study  is  included  as  Appendix  D.  In 
addition,  a committee  was  formed  to  make  a determination  os  to  the  applicability  of 
Al-'R  80-33,  Use  of  Volunteers  in  Aerospace  Research  to  the  in-house  DRT  program. 
The  committee  found  that  the  provisions  of  AFR  80-33  do  not  apply.  A report  of 
these  findings  is  on  file  at  ttie  COM  SEC  Engineering  Office. 

4.  3.  2 RECRUITING 

Listeners  were  recruited  by  advertising  in  local  newspapers  during  November 

1976,  Over  one  hundred,  responses  were  received.  Initial  screening  was  accom- 
plished by  administering  a pure  tone  atullometric  test  as  was  done  during  the  trial 
period  earlier  in  the  year.  Those  who  did  not  pass  the  test  were  not  considered  for 
the  job.  The  nature  of  the  work  was  explained  to  each  application.  They  were 
offered  $2.50  per  hour  for  one-iu’lf  day  <4-1/2  hours)  per  week  with  the  understand- 
ing that  they  must  successfully  complete  a training  period  and  that  they  were  subject 
to  removal  from  the  program  at  any  time  if  their  performance  was  not  consistent 
and  reliable.  The  first  eighteen  that  qualified  and  were  willing  entered  a training 
program.  Approximately  50  names  were  retained  on  a backup  list.  Since  then  the 
50  names  have  been  exhausted  to  replace  listeners  imany  did  not  want  the  job  when 
called  back  several  weeks  later).  On  one  other  occasion  an  advertisement  in  the 
newspaper  was  used  again  to  recruit  listeners.  Other  than  that  one  time,  word  of 
mouth  through  the  listening  crew  has  been  adequate  to  recruit  replacement  listeners. 

4.3.3  TRAINING 

A training  program  consisting  of  four  sessions,  each  four  and  one-half  hours 
in  length,  was  conducted  during  December  1970.  Of  the  eighteen  listeners  who 
started  the  program,  three  quit  after  the  first  session,  two  after  the  second  session, 
and  four  were  not  accepted  for  the  job  after  the  fourth  session.  The  remaining  nine 
stayed  on  as  part  of  the  listening  crew.  A second  training  period  consisting  of 
three  sessions,  each  four  and  one-half  hours  in  length,  was  conducted  in  January 

1977.  Five  candidates  from  the  backup  list  participated.  Two  quit  after  the  second 
session,  the  remaining  three  became  part  of  the  listening  crew.  Of  the  twelve  who 
were  selected  four  arc  still  part  of  the  listening  crew  after  one  year.  The  remain- 
ing eight  quit  at  various  times.  The  first  left  after  22  weeks.  The  mean  length  of 
time  these  eight  listeners  stayed  on  the  crew  was  30  weeks.  Replacements  were 
recruited  and  trained  as  required. 
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4.  3.  3.  1 Training  Material 

Training  material  consisted  of  repeated  applications  of  two  three-speaker  IJHTs 
that  had  hcen  processed  by  two  different  narrowband  vocoders.  The  two  DKTs  were 
administered  13  times  during  the  December  training  program.  Fifteen  single 
speaker  tests  were  administered  the  first  session  and  21  on  ouch  of  the  remaining 
sessions.  After  three  sessions  it  was  clear  which  listeners  would  not  ho  selected, 
therefore,  the  January  training  program  consisted  of  only  three  sessions.  The 
same  training  material  was  used.  Fifteen  single  speaker  tests  were  administered 
•luring  the  first  session  and  21  the  second  and  third  sessions.  The  speakers  were 
heard  repeatedly  in  the  order:  13V  JL  RD  13L  SN  CM.  The  first  three  speakers  had 
been  processed  by  a tenth  order  Linear  Predictive  Vocoder  (LPC)  at  a 3.6  kbps 
data  rate,  the  last  three  by  TRIVOC  (4-14)^  at  2.4  kbps.  These  DRTs  had  been 
•previously  evaluated  by  Dynastat.  Table  1 1 contains  the  mean  OUT  scores  and 
standard  deviations  obtained  by  Dynastat  for  each  of  the  systems  used  during  the 
training. 


Table  11.  DRT  Scores  Obtained  by  Dynastat  for  the 
Test  Material  Used  During  In-flousc  Training  Program 
in  December  1976  and  January  1977 


System 

Speaker 

Mean 

Standard  Deviation* 

1104 

BV 

06. 1 

2.80 

(IPC) 

je 

84.6 

1.53 

no 

89 .7 

1.32 

7003 

Bl 

8 7.2 

1.61 

(TRIVOC) 

SN 

86.8 

2.88 

CM 

95.2 

1.64 

•Standard  deviations  were  computed  from  furnished  standard  errors 
using  the  formula 

Standard  Deviation 

Standard  Error  ■ 


where 

N ■ number  of  listeners. 


6.  Wiggins,  R.  11.  (1976)  Narrowband  Digital  Voice  Processing  (CSP-30  LPC 

Software  Documentation),  Volume  1,  lsSb-TK-76-2»2. 

7.  Roberts,  J.  L. , Smith,  C.  P. , and  Wiggins,  R.  11.  ( 1975)  Triple-function  voice 

coder  (TRIVOC),  J,  Aeous,  Soc.  Am,  57  Suppl.  ^533. 


' 
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4.  3,  3.  2 Training  Results 

Time  and  space  does  not  permit  complete  exposure  of  the  results  for  every 
listener  who  entered  the  training  program  in  this  report.  Three  listeners  were 
randomly  selected  to  illustrate  the  kinds  of  results  obtained  during  the  training. 
Listener  3299  participated  in  the  December  1976  training  period  and  was  not  selected 
to  continue  in  the  program.  Table  12a  contains  a summary  of  all  DRT  scores 
achieved  by  this  listener.  Listener  5699  also  participated  in  the  December  training. 
This  listener's  scores  are  contained  in  Table  12b,  Listener  5699  was  selected  to 
continue  in  the  program  and  remained  with  the  listening  crew  for  25  weeks.  Lis- 
tener 9557  was  a member  of  the  January  training  group.  Scores  for  this  listener 
are  contained  in  Table  12c.  Listener  9557  was  selected  and  continues  to  be  a mem- 
ber of  the  crew  after  14  months.  Tables  12a,  b,  and  c also  contain  entries  for  the 
last  two  training  sessions  which  are  the  number  of  standard  deviations  the  listeners’ 
DRT  scores  are  from  the  Dynastat  scores.  These  entries  are  based  on  the  data  in 
Table  11.  Table  13a  is  a summary  of  the  number  of  times  each  listeners'  score 
was  two  or  more  standard  deviations  below  Dynastat.  Table  13b  is  a summary  of 
the  number  of  times  each  listeners'  score  was  three  or  more  standard  deviations 
below  Dynastat.  Over  half  the  time  listener  3299  scored  more  than  three  standard 
deviations  below  Dynastat.  In  addition,  this  listener  did  not  perform  consistently 
as  can  be  observed  in  Tabic  12a.  For  these  reasons  listener  3299  was  not  retained. 
Listener  5699  was  above  three  standard  deviations  below  Dynastat  over  80  percent 
of  the  time.  Listener  9557,  after  only  three  training  sessions,  scored  above  three 
standard  deviations  below  Dynastat  over  7 0 percent  of  the  time.  Doth  of  these 
listeners  scored  above  Dynastat  on  several  occasions.  In  addition,  except  for  an 
occasional  "outlier",  both  of  these  listeners  were  consistent.  These  tw'o  listeners 
were  selected  to  continue.  These  results  are  representative  of  all  who  participated 
in  both  the  December  and  January  training  periods,  Those  who  were  eliminated 
from  the  program  performed  as  did  listener  3299.  Those  who  were  selected 
performed  in  a similar  manner  as  listeners  5699  and  9557. 
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Table  12a.  Training  History  for  Listener  3299,  Top  number  is  DRT  score. 
Botton  number  (for  last  two  sessions  only)  is  number  of  standard  deviations 
listener  score  is  from  Dynastat  score 


R£P1 TITION  NUMBER 


Speaker 

1 

2 

n 

5 

6 

!~T" 

0 

9 

10 

11 

12 

13 

BV 

61.5 

71.9 

74.0 

74.0 

71.9 

70.8 

78.1 

-2.36 

76.0 

-3.61 

70.1 

-2.86 

68.8 

-6.18 

77.1 

-3.21 

77.1 

-3.21 

80.2 

-2.11 

JE 

6S.8 

74.0 

79.2 

70.8 

76.0 

78.1 

78.1 

-4.25 

82.3 

-1.50 

79.2 

-3.53 

85.4 

♦0.52 

83.3 

-0.85 

76.0 

-5.62 

81.3 

-2.16 

RO 

80.2 

78.1 

78.1 

77.1 

82.3 

79.2 

83.3 

-4.85 

86.5 

-2.42 

84.4 

-4.02 

85.4 

-3.26 

83.3 

-4.85 

87.5 

-1.67 

88.5 

-0.91 

BL 

69.8 

69.8 

71.9 

80.2 

83.3 

78.1 

74.0 

-8.20 

75.0 

-7.58 

83.3 

-2.42 

77.1 

-6.27 

85.4 

-1.12 

79.2 

-4.97 

83.3 

-2.42 

SN 

68. 8 

76.0 

69  8 

81.3 

76.0 

74.0 

81.3 

-1.91 

78.1 

-3.02 

80.2 

-2.29 

32.3 

-1.56 

82.3 

-1.56 

77.1 

-3.36 

79.2 

-2.64 

CH 

90.6 

85.4 

83.3 

89.6 

87.5 

84.4 

88.5 

-4.09 

67.5 

-4.70 

89.6 

-3.41 

93.8 

-0.85 

86.  S 
-5.30 

88.5 

-4.09 

86.5 

-5.30 

1 2 Decoder  ] 

i Dfc“rjer 

1C  December  j 

20  Oecember 

Table  12b.  Training  History  for  Listener  569B.  Top  number  is  DHT  score. 
Bottom  number  (for  last  two  sessions  only)  is  number  of  standard  deviations 
listener  score  is  from  Dynastat  score 


REP 1 T ! ON  NUMBER 


peaker 

i 

2 

n 

a 

5 

6 

7 

8 

9 

10 

11 

12 

13 

BV 

71.9 

83.3 

81.3 

82.3 

82.3 

82.3 

81.3 

-1.71 

82.3 

-1.36 

85.4 

-0.25 

82.3 

-1.36 

80.2 

-2.11 

87,5 

+0.50 

85.4 

-0.25 

JE 

76.0 

78.1 

79.2 

78.1 

81.3 

78.1 

80.2 

-2.88 

83.3 

-0.85 

74.0 

-6.93 

81.3 

-2.16 

77.1 

-4.90 

79.2 

-3.53 

79.2 

-3.53 

R0 

89.6 

86.5 

90. o 

91.7 

88.5 

87.5 

67.5 

-1.67 

90.6 
+ 0.68 

92.7 

♦2.27 

88.5 

-0.91 

90.6 

♦0.68 

92.7 
+ 2.27 

90.6 
♦ 0.68 

BL 

84.4 

86.5 

86.5 

86.5 

85.4 

82.3 

84.4 

-1.74 

85.4 

-1.12 

83.3 

-2.42 

87.5 

*0.19 

84.4 

-1.74 

86.5 

-0.43 

84.4 

-1.74 

SN 

74.0 

77.1 

75.0 

81.3 

81.3 

76.0 

81.3 

-1.91 

83.3 
-1  22 

81 .3 
-1.91 

79.2 

-2.64 

81.3 

-1.91 

77.1 

-3.37 

84.4 

-0.83 

CH 

88.5 

95.8 

91 .7 

90.6 

94,8 

87.5 

93.8 

-0.85 

88.5 

-4.09 

88.5 

-4.09 

90.6 

-2.80 

90.6 

-2.80 

92.7 

-1.52 

94.8 

-0.24 

Oecember 


9 Decmuer 


16  December 


20  December 


Table  12c.  Training  History  for  Listener  955  7.  Top  number  is  DRT  score. 
Bottom  number  (for  last  two  sessions  only)  is  number  of  standard  deviations 
listener  score  is  from  Dynastat  score 


Table  13a.  Number  of  Times  Table  13b.  Number  of  Times 

Listeners'  Score  Was  Two  or  Listeners'  Score  Was  Three  or 

More  Standard  Deviations  Below  More  Standard  Deviations  Below 

Dynastat  Score  (last  two  sessions  Dynastat  Score  (last  two  sessions 

only)  only) 
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5.  PERFORMANCE  OF  IN-MOUSE  DRT. 


As  discussed  earlier  in  this  report.  It  is  essential  that  DRT  scores  be  repeat- 
able  for  a successful  in-house  program.  In  addition,  it  is  desirable  that  in-house 
DRT  scores  be  comparable  to  Dynastat  scores.  Results  obtained  over  the  first  12 
months  of  the  in-house  program  indicate  that  both  repeatability  and  comparability 
have  been  achieved. 

3. 1 I jitener  Elimination 

Normally  a DRT  is  administered  to  10  or  12  listeners.  However,  it  is  likely 
that  one  or  two  of  them  are  trainees  and  one  or  two  may  not  be  performing  up  to 
their  normal  standard.  Therefore  a screening  process  is  used  to  eliminate  listeners 
from  a given  scoring  run.  The  number  of  listeners  is  reduced  to  eight  for  each 
scoring  run.  This  is  the  number  that  Dynastat  uses.  The  elimination  procedure 
used  has  been  developed  to  improve  the  consistency  of  the  listeners  as  a group  by 
eliminating  outliers.  Let  I.  = number  of  listeners  and  a = number  of  speakers  for 
a particular  DRT.  Suppose  X^  is  the  ith  listeners'  DRT  score  for  speaker  j where 
i = 1, . . , L and  j = 1, ....  S.  We  compute  the  mean  DRT  score  for  each  speaker  j. 

L 

j = r ^ j = 1.  • • • s . 

L i=l  ‘J 

We  then  form  a matrix  whoso  elements  D^  are  the  differences  between  the  ith 
listener's  score  for  speaker  J and  the  mean  for  speaker  j.  Thus, 

Dij=  Xij  l=  1’”'  Li  J=  8 ’ 

Those  listeners  who  are  performing  at  or  near  the  mean  for  all  speakers  will 
have  differences  that  are  near  zero.  Those  that  perform  exceptionally  low  or  high 
for  one  or  more  speakers  might  be  considered  outliers.  A measure  based  on  the 
magnitude  of  these  differences  is  used  to  eliminate  the  listener  who  is  an  outlier. 

The  measure  is 

a 

VAR.  s y L D. 1 s l,  • • , L ■ 

1 b >1  XJ 

The  listener  having  the  largest  VAR(  Is  eliminated  from  the  scoring  run.  L 
is  then  reduced  by  one  and  the  process  is  repeated  by  computing  new  speaker  means 
and  differences.  Again  VARj  is  computed  for  each  listener  and  the  next  listener 
is  eliminated.  This  procedure  is  repeated  until  only  eight  listeners  remain.  This 
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process  allows  for  the  possibility  of  very  high  scoring  listeners  to  be  eliminated. 
However,  it  has  been  our  experience  that  only  rarely  is  ^ high  scoring  listener 
eliminated. 

5.2  Repeatability  and  Comparability 

Every  listening  session  is  started  by  administering  the  same  three-speaker  DRT. 
We  refer  to  this  DHT  as  the  probe.  The  probe  was  also  used  during  the  training 
periods  in  December  1976  and  January  1977.  It  consists  of  the  first  three  speakers 
from  Table  11.  The  scores  obtained  by  each  listener  for  the  probe  is  closely 
tracked  in  order  to  monitor  the  listeners'  consistency.  The  mean  score  for  the 
probe  each  week  provides  us  a measure  of  repeatability  as  well  as  a comparison 
with  Dynastat  scores.  Additionally,  from  time  to  time  a particular  DRT  is  ad- 
ministered to  the  listening  crew  a second  or  third  time  in  order  to  measure  repeat- 
ability. Figure  10  is  a scatter  diagram  of  mean  DRT  scores  for  the  probe  for  40 
repetitions.  Each  point  represents  one  administration  of  the  test.  The  first  test 
was  given  on  14  January  19  7 7 and  the  last  on  22  December  1977.  Each  mean  is 
baaed  on  only  eight  listener  scores.  Elimination  of  listeners  was  accomplished  as 
described  in  Section  5.  1.  Also  included  in  the  figure  is  a conficence  interval  for 
the  mean  based  on  a Dynastat  score  of  86.  8 and  standard  error  of  0,  7 5 for  these 
speakers.  A rapid  learning  ttvnd  during  the  first  four  sessions  is  apparent  in  the 
figure  After  that  time  the  scores  are  rather  consistent  except  for  a drop  after  the 
22nd  repetition.  This  was  a time  when  several  new  listeners  were  added  to  replace 
departing  members  of  the  crew.  The  low  scores  for  repetition  numbers  23,  29, 
and  35  can  be  explained  by  noting  that  a full  listening  crew  was  not  available  on  those 
dates  and  trainees'  scores  are  included  in  the  mean.  95  percent  confidence  intervals 
for  the  mean  DHT  score  in  the  range  HU  to  90  arc  typically  two  to  three  points  wide. 
Most  of  the  scores  reflected  in  Figure  10  are  well  within  a three-point  band.  This 
indicates  that  the  in-house  listening  crew  performs  consistently  over  time.  In-house 
DRT  scores  arc  shown  to  be  comparable  with  scores  obtained  by  Dynastat  in  Table  14. 
Table  14  contains  mean  DHT  scores  and  standard  errors  for  those  systems  that 
have  been  tested  at  least  three  times  using  either  in-house  or  Dynastat  resources. 

A one-way  classification  analysis  of  variance  was  performed  on  the  scores  for  each 
system.  No  significant  differences  were  found.  This  indicates  that  m-house  and 
Dynastat  DRT  scores  for  the  same  system  are  essentially  the  same.  Thus,  direct 
statistical  comparisons  can  be  made  using  a mix  of  in-house  and  Dynastat  DRT 
results. 


6.  COST 


The  weekly  costs  to  conduct  in-house  DRTs  are  summarized  below: 
Listener  salaries 

12  listeners,  4-1/2  hours  at  $3.  00  per  hour 

Test  booklets 

252  booklets  at  $.  11  each 

Test  Administrator  Salary 

5 hours  at  approximately  $8.  00  per  hour 

Scoring  Cost; 

Scorer  salary  (6  hours  at  $3.  00  per  hour)  $ 1 8.  00 
Computer  No  Charge 

Total  cost  for  three  six-speaker  DHTs: 

Cost  for  one  six-speaker  DRT: 

In-house  $82.  85 


18.  00 


$ 24 i . 72 


The  above  in-house  cost  does  not  include  development  and  implementation  of 
the  in-house  capability.  These  additional  costs,  if  apportioned  over  a 3-year  period, 
would  add  less  than  $50.  00  to  the  cost  of  a single  six-speaker  DRT.  Overhead  costs 
have  not  been  included  in  the  above  figures.  Allowing  for  as  much  as  100  percent 
for  overhead  results  in  a final  in-house  cost  ior  a six-speaker  DRT  that  is  sig- 
nificantly lower  than  that  charged  by  a contractor.  Sufficient  demand  exists  to 
utilize  the  entire  in-house  capability  of  150  six-speaker  DRTs  each  year,  thus 
realizing  a large  cost  savings. 
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7.  CONCLUSIONS  AND  RECOMMENDATIONS 


It  is  concluded  that  the  in-house  URT  capability  is  a cost-effective  means  of 
providing  a needed  measure  of  voice  communications  intelligibility.  It  provides 
reliable  data  that  is  based  on  a widely  accepted  measure  of  intelligibility  that  is 
fast  becoming  a DoD  Standard,  it  has  been  shown  that  the  in-house  testing  provides 
results  that  are  equivalent  to  those  provided  by  contractor  resources  at  a large 
cost  savings.  The  in-house  capability  provides  the  additional  advantage  of  rapid 
turnaround  time,  thus  allowing  decisions  to  be  made  in  a timely  fashion.  The  re- 
duced unit  cost  of  in-house  DRTs  allows  us  to  perform  the  large  number  of  DRTs 
required  for  our  on-going  algorithm  development.  Contractor  costs  for  the  number 
of  DRTs  required  would  be  prohibitive.  In  addition  to  substantial  cost  savings  and 
speedy  turn-around,  it  is  essential  for  the  Government  to  have  an  in-house  mecha- 
nism fur  validating  results  that  might  otherwise  only  be  available  from  one,  or  very 
few  other  sources.  T!...,  is  particularly  important  in  view  of  the  decisions  based 
on  these  results.  It  is  recommended  that  the  in-house  capability  be  maintained. 
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It  is  a valuable  resource  that  has  widespread  application  throughout  the  Department 
of  Defense.  This  capability  could  be  expanded  to  serve  the  needs  of  other  agencies 
requiring  intelligibility  testing  and  thus  realize  its  maximum  potential  benefit.  It 
is  further  recommended  that  continued  use  of  contractor  resources  be  made  for 
conducting  DRTs  so  that  independent,  unbiased  results  can  be  obtained  at  key  points 
in  our  investigations.  This  will  further  serve  to  verify  in-house  results  and  provide 
a periodic  comparison  between  in-house  and  contractor  DRT  scores. 
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1 1,0, 0,1, 0,0, 1,0, 1,1, 3*0, 1,1, 0,1, 3*0, 3. 1,0, 0,1, 0,3*1, 3 *0,1, 

104  B KEY 

1 3*1, 4*0, 3*1, 0,0, 1,1, 0,1, 0,4*1, 0,0, 1,1, 

1 0,0, 3*1, 0,1, 0,4*1, 0,1, 1,0, 1,0, l, 0,0, 1,3*0, 1,0,  1,0, 

103  A KEY 

1 0,3*1, 0,0, 3*1, 0,1, 1,0, 0,1, 1,0, 0,1, 0,1, 

1 0, 1, 0, 1, 1, 0, 0, l, 0, 0, 1, 1, 0, 0, 1,1, 0,10*1, 5*0, 3*1, 

105  B KEY 

1 0, 1 ,0,4*1 ,0, 1, 3*0, 3* 1,3*0, 1 ,0, l, 1 ,0, 1 , 

l 0,1, 0,1, 0,1, 1,0, I, 1,0, I, 0,0ft #4*0,3* 1,0, 1,1, 0*0, 


1 


106  A KEY 

0,3*1, 0,0, 1,0, 1,0, 0,1, 0,1, 0,1, 0,0, 1,0, 1,0, 1,0, 3, 3*1,0, 
0,0, 4*1, 0,1, 0,1, 0,1, «*0, 3*1, 0,1, 0,0, 3*1,0, 


106  8 KEY 

1 3*1, 0,1, 0,0, 11*1,3 *0,1, 3*0, 1,1, 

1 1,0, 1,1, «,1, 0,1, 0,1, *,1, 1,0, 1,3*0, 1,0, 1,1, 4#0, 1,0,0, 

107  A KEY 

l 0, l ,0,0. 1, 1,4*0, 1,0,0, l, 1 ,4*0, 1 ,0, 1,0,0, 1,0, 3*1 , 

1 0, 0,3*1, 0,0,1, 1,0, 0,1,0, 4*1,0, 3*1,0, 0,1, 1,0, 0,1,1, 

107  8 KEY 

1 1,0, 1,0, 1,1, 0,1, 1,0, 1,1, 0,1, 0,1, 0,3*1, 0,1, 1, 0,1, 1,0,1# 

1 0, 0,1, 0, 1,0, t, 1,0, 1,0, 0,1, 0,1, 0,0, 3* 1,0, 1,0, 0,3*1, 

108  4 KEY 
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c 

c 


c 
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c 
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c 

c 


c 

c 


c 

c 


i i,s*«, 3*1,0, 1,4*0 ,1,0, 1,0 ,0,1 ,1,0 ,0,1, 1,0, 3* 1,0, 

i 3*1, 3*0, 5*1, 0,1, 1,0,1, 0,8, 1,0, l, 4*0, 4*1, 

IBS  B KEY 

l 0,0, 1,1, 3*0, 3*1, 0,0, 1,1, 3*0, 8*1, 0,1, 0,0, 3*1, 

1 0(0|3*1(3»|| 1,0, 1,1, 0,0, 3*1 ,0,3*1, 0,0, 1,1,0, li 

m * key 

1 1,1,0,0,3*1,3*0,3*1,3*®,1,®,1,0,®,1| 

t 3*0 , 3*1, 0, 8, 6*1,0, 1 ,0, 1) I ,3*0, 4* 1,0,0, 3*1,0 ,0,1, 0,1, 

in  e Key 

1 0,0,3*ll3*0,l,0,l,0,l«l|4*t,l,l,9,l,0, 

1 3 *1,0, 3* 1,0,  1,0, 1.7*0, 1 i 1.  1,1,  1,9*0,  1,®,®,1  iM.li 

n2  * key 

1 1*3*0, 1,1, 3*0, 3*1, 0,1, 1,0*0, 1,5*0, 1,0, 

1 0,  1,0, 0,1, 5*8, I ,1,0, 1,0, 1,0, 0,1, 0,1, 4*0, 4*1, 

112  e xey 

1 0, 4*1,8, t , 8,0, 1,0,0, 1 ,0.4* 1*3*0, l, 3.8, 4*1, 

1 4*0, 1,0, 4*1, 0,0, 1,1, 3*0, 1,1, 3*0, 1,1, 0,1, 1,0,1, 

113  a key 

1 3*0,6* l, 0,0, 1,1, 0,3* 1,0, 0,3* 1.0. 1,0,1  I 

1 0,0, 1,1, 0,3* 1,0 ,1,0, 0,3* 1,0,1, 0,1, 1,0, 4*1, 3*0, 1,0,1,  1, 

1138  KEY 

1 1,0, 1,1, 0,0, 1,8, 1,1, 0,1, 1,0, 1,0, 4*1, 

1 0,1, 0,1, 0,1, 0,9*1, 0,1, 0,1, 0*0, l, ®,3* 1,0,1, 4*0,1, 

115  A KEY 

1 1, 0,1,1, 0,3*1, 0,0, 1,1, 0,0, 1*0* 1,1, 0,1, 0,3*1, 3*0, 

1 0,1, 0,1, 3*0, 4* 1,0, 4* 1,0, 0,1, 0,0 ,1,3*0, 1,0, 1,1, 

113  B KEY 

1 4*0, 1,4*0, 3*1, 3*0, 1,1, 4 *0,1,0, 3* 1,3*0, 

1 1 , 1,0, 0,4* 1,4*0, 3* 1,0, l, 0,3* 1,0, 3*1,0, 3*1 , 

116  A KEY 

1 0,4* 1,0, 1,0, 1,0, 0,1, 0,0, 1,0, 1,3*0, 1,0, 0,1, 0,1, l, 0,1, 

1 0, 1,1, 3*0, 4* 1,0, 5* l, 0*0, 1,0, 4* 1,0, 

116  B KEY 

1 3*1, 0, 0, 3*1, 3*0, 1, 3*0, 1,0, 1, 0,1, 0,1, l, 0,0, 1,2, 

1 0,0, 3*1, 0,0, 3*1, 0, 0,1, 8,6, 1,0# l, 0,1, 0,0, 1,0, 1,0* 3*1, 

3H1  A HEY 

1 0, 0,1, 1,1, 0,0, 0,1, 0,0,1, 0,0, 0,1,1, 0,1, 0,1,0*®«1*1*0»1*®|0« 

l t,e,e,i,M,3,t,l,(,i,t,l,0,i,M,t,t,l,l,l,0,Mil,iii<i, 

301  8 KEY 

1 0,0,t,t,t,0,l,l,^,0,A,l,l,l,l,t,i,l,l,l,l,0,0,0,6,0,l,l,l, 

1 1, 1,1, 0,1, 1,8, 8, l, B,!,!,®,®,®,!,®,!,®,!,®**!!*®*!/®*1*®*1' 

303  A KEY 

1 0, 1, 0,1, 0,0, 1,0, 1,1, 1,1, 0,0, 1,1,1, 6,0, 1,0,!’0,®,!<0’I’I>1’ 

l 0,0, 0,0, 1,0, 0,®, 1,1, 1,0, 1,0, ®,®, 1,1, ®,®, 0,1, 0,0,1,®,®,!#!, 
303  B KEY 

1 0,0, 1,1, 0,0, 0,1, 0,1, 1,1, 0,0, 0,0, 1,1, 1,0, 1,0, 0,0, 1,0, 0,1,®, 
1 0, 1, 1, 0, 0, 0, 1, 0, 1, 0, 1, 0, 0, 0, 0, 1,®, I, l,®, l,®,®, ®*1, i, 1,®,1, 

3*3  A KEY 


120 


1 


0#0#l#0r0ilfi#0,0#l#0#0#l#0#i#l#0,0,l#0,0f0,l,l#l,l,0f0#l, 

1 , 0 , 1 I 1#  1 # 0 , 1 f 1,1  f l | 0 , I , 1# 1 , ® # ® , 1 # 1 , 

303  6 KEY 

0,l#i,l,i#B,i#l#0,0,i,0,0,l,i,i,0,0,0,0,0#l,0#0,0#l#*|l,0, 

Qfflf tt0i 1 # 0 # 0 # 1 , 0 # 0 | 1 # 0 # l # l,0,i,l,0#0,0,0# 1,0, 0,0,1, 0,0,®, 

304  A KEY 

0, 1,1,1, 1,1, 1,1, 0,1, 1, 0,0,1, 1,1, 1,0, 1,1, 0,ift,0f0#0f®f®9®t 
304  B KEY 

Irl#0#l0l|0#0#0tl#6j0,0,i,l,i#l,if0#l#0fl#l,0fl,i,l,l,l,l, 
0,l,l,0,0,0,0,l,i,0,0,l#l, 0,1, 0,1, 0,0, 0,0, 0,0, 0,0,0, 1,0,1, 

303  A KEY 

0#l#0,0#l#0,l,0,l,l,0,l#l,l,l,0,®,l,0,lfl,0,l,tfl,l,®,0,0, 
0#0, 1,0,0#0, l#l#l,0#t,0# 

303  B KEY 

lfl#0#l#0,0#0#l#!,l,l,l#l,0,0,®,l,l,0,i,lfi,lfl,0,l,l#l,®, 

i#0#l,0#l#0|l#i#l#0#l,0#0,l,0#0,l#0#®,l,0|l#0|0/l#l#l,®#l| 

306  A KEY 

1#1,0,1#1,1,1,0,1,1,1,0#1,  1,0,  1,1,1,®,  1,1, 0,0, 0,1, 0,1,  1,0, 

0f0»0flflflf 1,1,1# 

306  6 KEY 

0 # 1 # 0 i 1 t 0 # 1 # I|0fl|0|l|tf0flf}flf0f0|0flf0|lrl|0flf0f  1 # ® , 1 # 

0#l#0#i#0#lfl#0,l#l,l,0#0,l,0#l,i,0|l,i#l#0#l#0,l#l#l,l#l, 

307  A KEY 

1#1#1#0#0#0#1|1#1#0#0#1#1,0,0#1#1#1#1#0#8#0#1#1#1#1#®#1#I# 

0 f i,0,0«0,|  , 0 , i;0#lfl,  1 # 0 # 0 # 0 # 1 # 1 # l#ijl#0#lf0#  1 # 0 # i # l # 0 # 0 # 
307  B KEY 

1 # 0 , 1 # 1 # 1 # 0 # t|0il*ljl»l<lii»0»0#W0»0»0»lil>0|l»l»0»®#W^ 
1 # l#l#0«0#0# 1 1 l|0f  1 # 0 # 1 1 1# If  if  l#0#ii i#if0»0» i * 0 # 0 > i # 0 * i r 0 » 

300  A KEY 

!#0#lf0fl#0f 1,0, If 1,0,0, I# 1,0,1, 1,0, 0,1, 1,1, 0,0,0, 0,0 #0,0, 
0,l#l#l#0#0#l#l#0#l,l,l#lfl#0,!,0,0,l#0#0,l,l#0,l,l,0,0fl| 

300  B KEY 

1.1.1.1.1.1.0. 1#0,0,i,0,0,i,0,i»i,i,i,i,0,i,0,0,i,ii0’i'®* 
0,0#0#0#0#0#®#®,1#0#0, 1,1, 0,1,®, 1,0, 0,0,1,®, 0,1,0, 0,0, ®,0, 

300  A KEY 

1 1 1#0, 0,1,0#®#®, I#0f0f0f0f0f0f0f0f0f0#0f 1,1# 1#  J f 0 # 0 i 1 # 1 # ® # 

0 $ 0 $ I # 0 # 0 # 0 # I ,1#®#0,0# 1 # 0 # 0 f I f I#  ^ #0  #0#® # I f0f0|fl|0|9f 1 # 1 # ® , 

300  6 KEY 

0 # 1 # 1 # I ,0,0,  l#0#0#0,®f0#0,B#0,i#0#®,l,®,0»l#0#l#l#0, I # 0 , 0 , 
l#8#l#0#0#l#l,®#l#l,l#0,lfi#0#l#l#0,l#0il#t#0,l,l#®#0#0#0, 

310  A KEY 

1.0. 0.1.0.0.1.1.0,t,l#i,0,0,l,0|0,0f0,0|ifl,i,0,0,lf0f0flf 

1 .1.0.  1.1. 1 1 0. 0. 1 .0. 0 . 1.0.0# 1,1, 0,1, 0,0, 0,1, 0,1, 0,0, 1,1,0, 

310  0 KEY 

1.0. 0. 1.0,  t»-  1,0, 0,0,1,  1,1, 1,0,0#  i#0,0,l,0,0#0,l#l  # 1,  1,  1#  1, 
0 # 0 # I # 1,0# 1#  & # 1 # 1 ,1,0# l#0#0#0#i# 1 #0#0#0,0,0# 1 #0,0# 1,1,0#  1# 

311  A KEY 


1 

C 

C 311  ft  KEY 

1 Btl#ltl|0f1tlfltlf9fF)#lfl|0fl#0flr9t^f0fQlfQrlflflplf0a0fl# 

C 

C 312  A KEY 

1 1,1, 1,0, 0,0, 0,1, 1,1, 1,0,0, 0,1,0,®, 0,1, 1,0, 1,1, 1,0, 0,0, 1,1, 

1 1,1, 1,0, 0,0, 1,1, 0,1, 0,0, 1,0, 0,0, 1,0, 0,1, 1,1, 1,1, 1,0, 0,1,®, 

C 

C 312  S KEY 

1 0,1,1,0,8,0,1,0,1,0,0,0,®,0,0,0,0,0,1,0,1,0,1,0,1>0,0,1,®, 

1 0,0,0,0,1,1,0,1,1,0,1#®#0,0,1,1,®,1,1,1,8,1,0,0,B,1,®,1,0, 

C 

C 313  A KEY 

1 0,0, 0,1, 0,1, 0,1, 8, 0,1, 1,1, 1,0, 1,0,1, 0,1, 0,1, 0,1, 8, 8, 0,1,1, 

1 0,1, 1,1, 0,1, 0,1, 0,0,  1,0, 0,0, 0,0, 1,0, 1,1, 1,1, 0,2, 0,1, 1,1,0, 

c 

C 313  a 

1 1,0, 0,1, 0,0, 0,1, 1,0, 1,0, 0,0, 1,0,  1,0, 0,0, 1,0, 1,1, 0,0, 1,0,0, 

1 1,0. 0(0, 0(1, 0,0, 0,0,  1,0, 0,0(1, 1,0, 0,0,1, 0,0, 0,1, 1,1, 1(1, 0. 

c 

C 314  A KEY 

1 0,0, 0,0, 1,1, 1,0, 0,1, 0,0, 1,0, 0,0, 0,8, 0,1, 1,0,  1,0, 8,0, 1,0,1, 

1 1,1, 0,0, 0,1, 1,0, 0,1, 1,1, 8, 0,1, 0,e, 0,0, 1,0, 1,0, l, 0,0, 0,0,1, 

C 

C 314  a KEY 

1 1,0, 0,0, 1,0, 0,0, 1,1, 1,0, 0,1, 0,0, 0,0,1  ,0, 0,1, 0*0, 1,  1,  1,1,1, 
1 0,1, 1,1, 0,0, 1,1, 1,1, 0,1, 0,1, 1,1, 0,1, 1,1, 1,0, 1,1, 0,0, 0,0,1, 

C 

C 313  A key 

1 1,0, 0,1, 0,1, 1,®, 8,1, 8, 1,1, 8,0, 1,0, 0,1, 1,1, 0,1,1, 0,0, 1,8,1, 
1 1,0, 0,1, 1,0, 1,0, 0,1, 1,1, 1, 1,1, 1,1, 0,0, 1,0, 0,1, ®,1, 1,0, 0,0, 
C 

C 3 1 3 B KEY 

1 1,1, 1,0, 0,0,  1,1, 1,1, 0,0, 0, 1,1, 0,0, 1,1, 0,0,  1,0, 1,1,1,  1,1,1, 
1 0,1, 1,1,  1,0, 0,1, 1,0, 0,0, 0,1, 0,0, 1,0, 0,0, 1,0, 1,1, 0,0, 0,®,1, 
C 

C 3J6  * key 

1 1,1, , 0 , ® , 1,1,  1,0, 0,0, 1,1,1, 1,1,  1,6, 0,1, 1,0, 1,1, 0,0, 0,0,1, 
1 0,1,1,1,0,1,0,1,0,0,1,1,0,0,1,0,1,1,1,0,0,0,1,1,1,0,0,1,0, 
r 

C 3l«  8 KEY 

1 0,1, 0,1, 1,1, 1,1, 0,0, 0,1, 0,0, 1,0, 0,1, 0,1, 1,®, 0,1, 1,1, 0,0,1, 
1 0,0, 1,0, 0,1,  1,0, 1,0, 1,0, 1,1,  1,1,  1,1,  1,1, 0,0, 0,0, 0,1,  1,0,1, 
C 

C 31/  * KEY 

1 0,0, 0,1, 1,1, 1,0, 0,0, 8,1, 1,0, 0,0, 1,0, 1,1, 0,0, 0,1, 1,0, 1,1,1, 
1 1,1, ®,1, 0,0, 1,0, 1,0, 1,1, 1,1, 1,0, 1,0, ®,1, 1,1  ,1,1, 0,0, 1,0,0, 
C 

C 317  a KEY 

1 0,1, 0,1, 0,1, 1,0, 1,1, 0,0, 1,0, 1,1, ®,1, 0,1, 1,1, 1,0, 1,1, 1,1,0, 
1 0,0, 0,0, 0,1, 1,0, 0,0, 8,1, 0,0, 1,1, 1,0, 0,0, 1,1, 1,0,  1,8, 0,1,1, 
C 

C 310  A KEY 

1 0,1, 1,1, 1,1, 0,1, 1,1, 0,0, 1,1, 1,0, 1,1, 1,1, 1,0,1, 0,0, 0,1, 0,1, 
1 0,1, 1,1, 0,0, 0,0, 8,1, 0,0, 1,0, 0,8, 0,1, 1,1, 0,1, 1,1, 1,1, 1,0,1, 
C 

C 318  B KEY 

1 1,0, 1,0, 1,0, 0,1, 0,1, 0,0, 1,0, 1,1, 0,1, 1,1, 0,8, 0,1, 0,1, 0,1,0, 
i 1,1, 1,0, a, 3,1, l,0, i,i, 1,0, i,i, 0,1, 0,0, 1,8, 0,0, 0,0, i,i, 0,1/ 
c 

C SU8  Ft ATU8ES  KEY 
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. « MWWM ■**■*» -Ifflnttlltldi  ■ lln'lri  |fc-fl|j|||( 


^ 1 ■ :|  wi  ] 1 * "i 


m.  i 


DATA  KEYSU8/0,0,1,0,1,0,3*1,3*B, l,  1,3*0, 1,0,1, 1,4*0, 1,3*8, 3*1, 
3*0,1, 0,1,8, 1,3*8 ,7*1,8, 1,4*8, 1,1 .8,1 ,8, 1,3*8, 1,8, 1,3*8, 1,1, 
0,1, 0,1,1, 0,4*1, 3 *0,1, 3 *8, 3*1, 0,3* 1,0, 3*1,8, 1,8 *0,1, 0,4*1/ 
CHCT(X,n  • (2 ,*X/Y  . I,)*li0, 

St(«,T,Z)  • SQRT( (X/Z*Y*T)/Z) 

00  1 1*1,20 
00  1 J • 1 , 2 
E*PtR(l, J)*0, 

00  1 0*1,3 
vtiic  (I , J,x ) *0 , 

X N AS  AL (1 , J , K ) *8, 

SO  S T (I , J,K) *0, 

sibilci, J, *) *e, 

GKAvU,  J,K)«0, 

COH0C1, J,K)«0, 

CONTINUE 
00  313  1*1,3 
00  3|3  3*1,2 
TO! 1 1 , J ) *0 , 

02420.0116000.014 
WKITE(6,270) 

FORMAT (30X, 'DIAGNOSTIC  RHYME  TEST'///) 

*«HE(0,271) 

Format ( 'LISTENER  Summaries!') 

02400. 0116000.014 

WRITE (3, 100) 

FORMAT!//'  DIAGNOSTIC  rhyme  TEST  SCORING'//) 

wKltt(3,600) 

format c insert  130  ft  cartridge  In  upper  oec*'/ 

• 1/0  RESET  • CONTINUE'//) 

PAUSE 

wRl  It  13, 1000) 

FORMAT  C 'STSTtM  UNDER  TEST'/'/'  ',30('S')5 

fit AO (3, 1001) ( IS VSTE (!),!■ 1,30) 

FORMAT (30*1 ) 

wRUE  (5, 101 ) 

FURmaTChom  MANY  LISTENERS?'/'  LL') 

Rt  AD (3 , 102JNUML 
FORMAT (12) 

WRITE (3, 103) 

FORMAT ( / ' MOw  MANY  SPEAKERS!'/'  SS'J 
REAOO,  102)  NUNS 
NUMT  ■ 1 6*  NU  MS 

NUNSU0  * tt • N 0 MS 

MR ITE (7,601) (ISTSTE(I) , 1*1,30) ,NUML,NUMS 
FORMAT (30A1 ,213) 

Ou  200  LIST  ■ l.NUML 
WRITE (6 . 3001  ) 

wrIiE(6,3000) (ISTSTE(I), 1*1,30) 

FORMAT ( /50A 1 ) 

FORMAT  ( ' ' ) 

wH11E(3,2000)LlST 

FORMAT (/ 'LISTENER' , 13, ' NAME'/'  ',24('N')) 

RtAO(3,200l) (NAME (LIST, J) ,J*l,24) 

FORMAT ( 24  A 1 ) 

wRITE(0,273)LIST,(NAMt(LXST,J),J*l,24) 

WRITE (7, 2001  ) (NAME (LIST, J), J*  1,24) 

00  201  ISPKR  ■ 1 , HUMS 

00  610  1*1,7 

00  610  J • 1 , 2 

OU  610  K*l,3 

PAGt (I , J,A)  * 0,0 

wn  1 1 E ( 3 , 104)L1ST, ISPKR 


123 


FORMAT (/ ' FOR  LISTENER ', 13, ' SPEAKER  1 , 13// 

(ENTER  ACT  NUMBER  AND  LETTER • / ■ NNNL • ) 

RtAO(8,JRS)IKET, LETTER 
FORMAT (13, At) 

FORMAT {//SX, »••••', 16X, »••»/*  RE  r * ' , 13, A l , 

SX, (SPEAKER  IS  * , A2/6  X, >••**', |4X,  •*»'// (JF  OK  ENTER  8'/) 
FORMAT (II) 

1F(IKEY,EB,1S2}NKEY  • HMSPKI'ByHGQTO  138 
IF (IKET.EU, JS3)NKEY  • 3«HSPK* 'BV » 06QTO  138 
1F(IKEY,EB,184)NH£Y  * 8«MSRK*(R0'06QTQ  138 
IF(IKEYtEU,l63)NKET  ■ 7«MSPKi * RO ' 6GOTO  138 
IFdKEY.EQ.lSSINKEY  • 80MSPK*  ' BL  1 06QTQ  ISB 


IF(IKEY,EU,1®7)NKEY  iUOMSPKi'CNHGQTQ  158 
IF (IKEY.EO, 108)NK£Y  • 1 3 »HSPK» • CM t OGOTU  138 
IF(IKEYlEBllll)NKEY  ■ 1 BRMSPKi t JE I OGQTO  188 
1F(IKEY,CQ,112)NKET  • 1 79MSPKI I BN ' OBOTO  138 
IF (IKEY,EO,l 13)MKEY  ■ 1 BtMSPKi ( JE I OSQTO  138 
IF (IKtT.EU, 1 151NKET  «2 1 OMSPKi ( SN I OCOTQ  138 
IF(1KEYIEU,|16)NAET  *23«MSPK» • BL ' 06QTQ  158 
IF(1KEY,ST,318)60T0  131 

IF(1KEY,CT,388)NKEY  ■ 23*2«(IKET«3B1}8C0T0  138 
GOTO  131 

IF(LETTER,EG,'B()NKET  • NKEY*l*GOTO  132 
IF(LETTfcR,EO,'A()GOTO  132 
HRITEd,  186)  IKEY, LETTER 

FORMAT (/(•••••••  NO  KEY(,I4,Al,'  «••*•••»'//) 

GOTO  107 
CONTINUE 

IF  (IKEYaLT,117)GOTO  788 
nRITE(3|7h1) 

Format (// 'speaker  t'/'  ss*) 

Rfc AO ( 3,  782) MSPK 
FORMAT (A2) 

MR  I TE  (3, 473) IKEY, LETTER, MSPK 
f)CAD(3,476)KEYCHK 
IF(KEYCHKtNE|0)GOTO  107 
AH  I TE (6, 2U8) MSPK, IKEY, LETTER 
FORMAT [21X,a2,7X, 13,  Al) 

00  118  IPAGE  ■ 1,4 
mw1TE(3,188)IkEY, LETTER, LIST, IPaGE 

F0RMAT(/IF0H  KEY', 1 4 , A 1 , ' LISTENER', 13, ' PAGE', 12/7 

(ENTER  RESPONSE  BY  COLUMNS' //' 1 • FIRST  JiORO  2 ■ SECOND  NORO'// 

' HRRRRRRRRRRRRRRRRRRRRRRRRRRRR ' } 

00  112  III, 2 

REAQ(5,lll) (IRESP(I,J),Jll,2S) 

FORMAT (2911) 

CALL  CmECK(|330) 

00  282  HI, 2 
00  282  Ji 1 , 29 
lHtSP(I,J)iIRESPU,J)«l 
00  283  ICOLi 1 , 2 
00  284  IRON  12,29 

ESTABLISH  feature  being  scorep 
IFUROn.LE.S)  IFEATilRQNM 
ITEMP  IJR0N.1 
IFEAT«M00(ITEMP,7) 
lF(IFfcAT,E«,8) IFEATiF 

ESTABLISH  NMlCM  COLUMN  PRESENT  STATE  OF  FEATURE  IS  IN, 

IPRESli 

If (IPAGE, LE,2)IPRES»B 
FIND  KEY  ELEMENT 
KEYELiIHOn 

IF  UCUL,EU,2)KETEL»IR0N*29 
INDEX  • 2 
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IF  (IPAgE.ES,  DGOTO  288 
IF  (IPAOE,tO,3)6OT0  288 
IF(XEY(KEY£L,NK£Y),NE,1PRES) INDEX* 1 
GOTO  288 

298  lF(K£Y(K£Y£L«NK£Y)i£0tlPRE8) INDEX M 

C INDEX  p1  IMPLIES  MAIN  FEATURE  PRESENT!  2 IMPLIES  ABSENT, 

C SLONE  THE  RESPONSE 

298  ANSMEN  • 0,0 

IMIPAGE.tQ,  UGOTO  293 
IF  (IPAGE,£0,3)  GOTO  29S 

IF  (KEY  (KEYEL»NKEY) ,NE,IRESP(ICOL«IPON) )ANSMeR«t,B 
GOTO  296 

293  !F(K£Y(K£Y£L'NKfcY),£Q,IRESP(ZC0L'XR0H))AN3N£R«l,e 

ivts  CONTINUE 

IF(IFEAT,EQ,7)G0T0  287 

ISUBF«2 

NSU8P*2 

IF ( IPAGE ,£0,1) ISUBPvl 
IF ( IPAGE , EG, 3) ISUBPtl 
IF(KEYSUBCNEYEL, ISUbP) ,E8,I)NSUBF*3 
GOTO (251, 252, 233, 254, 233, 236 ),IFl AT 

231  VUIC (LIST, INDEX, 1}«Y0IC (LIST, INDEX, DpANSWER 
VOIC(LIST, INDEX, N$UBP)«V0IC (LI  ST, INDEX, N3UBP)«ANSHER 
P AGE (1, INDEX, 1) «P AGE (1, INDEX, 1)»An8mER 

P AGE  ( 1 , INDEX, N8UBP)  ■PACKS,  INDEX, NSUBP)* answer 
GOTO  260 

232  XNASALUI8T,  tNDtX,  l)»XNA»AL  (LIST,  INDEX,  1)*ANSnER 
XNASAL(LI8T, INOF.  X,N8UBP)«XNASAL (LIST, INDEX, NSuBP) *ANSmEN 
PAGE (2, INDEX, 1) «PAGE(2, INDEX, t ) *4n8nER 

PAGE (2, INUEX»NJUSP)*PAGE{2, INDEX, N8U8P)*ANSNER 
GOTO  260 

233  SOST (LIST, INDEX, 1)pSUST (LIST, INDEX, 1)*ANSNER 
SUST(LIST, INDEX, NSUBP)«SUST (LIST, INDEX, NSUBP)»ANSNER 
PAGE (3, Index, n iPAGE (3, INDEX, 1)*AN3nER 

PAGE (3, lNUEx,N8uBP)»PAGE(3, INDEX, nSUBPJpANSNER 
GOTO  2B0 

234  SIB IL (LIST, I NDEX, I) (SIBIL (LIST, INDEX, S)*AN8MER 
SI8IL(LIST, INDEX, NSUBP)»S1BIL(LIST, INDEX,NSUBP) ♦ANSnEN 
PAGE (4, INOEX, S)«PAGE(4,IN0EX,|)«ANSHER 

PAGE (4, INOEx,NSUBP)«PAGE(4,INOEX,NSUBP)*ANSmER 
GOTO  260 

298  GHAV(LI3T,In0EX,1)»GRAV(lIST,IN0EX, 1)*AnSmER 

GNAV(LIST,IN0EX,NSUHP) ■6RAV(LIST,IN0EX,nSUBP)«ANSNER 
page (3, index, n (PAGE (9, INDEX, S)«AN82ER 
Page (3, INUEX,NSUBP) iPAGE (3, I NOE  X , NSUBP ) ♦ ANSNER 
GOTO  260 

236  COMP (LIST, INOEX, l)*COMP(LI8T, INDEX, S)*ANSXEH 

COMP (LIST, INOEX, NSUBP) »C0MP (L I ST , INOE X , NSOBP) ♦ANSWER 
PAGE  (6, INOEX , 1} (PAGE (6,  INOEX, 1 )«ANSmER 
PACE  (6, INOEX , NSUBP) »PAGE(6, INDEX, N8UBP1 ♦ ANSWER 
GOTO  260 

23/  EXPERtLlST, INOEX) »EXPER (L I ST , I NOEX ) ♦ ANSMEN 

PAGE(7, INDEX, l)aPAGE(7, INDEX, 1)*AN6MER 
260  CONTINUE 

204  CONTINUE 

203  CONTINUE 

110  CONTINUE 

DO  6 1 1 1*1,7 
OU  611  J M , 2 


00  611  K • S , 3 

611  NPAGE(I,J,X)  »IFIX  (PAGEd,  J,X)*,3) 

NHIT£{7,S73) M8PK 
678  FORMAT ( A 2 ) 

MR  I TE  (7,  Si  2)  (((NPAGEd,  J,K),  1*1,7),  J*S,2),K*l,3) 
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f 


I 


F0RMATU3) 

CONTINUE 

IRASS  • l _ 

FORMATI/VOX,  'LISTENER', 13,  ' SPE  AKER  • , 3X , ' FEY  t , 3X,  84A  1 ) 
WRITE (6,  301 ) 

FURMAT(/SX, (NUMBER  OF  CORRECT  RESPONSES! •//) 

UH  t Tf  (fl  Of  AT 

FORMAT c tax « ' MAIN  ATTRIBUTE! * , ISX, • PRESENT ' , 7X , • ABSENT ' // ) 
WRITE (0,277) (V0IC(LIST, I, |),Ilt,l) 

FORMAT  USX, 'VOICING',2SX,F7,2,0X,F7,2) 

WRITE (0,278) (VOIC  (LIST, 1,8) ,I«1,2) 

FORMA T(20X, 'FRICTIONAL' , 1 3X , P 7 * 8 , 8X ,P7 *8) 

WRITE (6, 276) ( VO  1C (LIST, I, 3), 1*1, 2) 

FORMAT (20X, 'NON-FRICTION At ' ,8X,P7 ,2,8X,F7,2/) 

WRITE  (6,260)  (XNA8ALUIST,  I,  1)  ,I«1«B) 

FORMAT  USX,  'NASALITY',  1 6X  , F7 , 2 , 0X  , F 7 , 2 ) 

WRITE (9, 28 J) (XNA8At(tIIT, 1,2) , X • I ,8) 

FORMAT  (20X,'GRAVE',18X,F7,2,0X,F7,8) 

WRITE  (6, 282)  (XNASALUUT,  1,3)  , lit  ,8) 

FORMAT (20X, ' ACUTE', 1 6 X , F 7 , 2 , 8 X , F 7 , 8/ 5 
WHITE (6, 283) (SU8T(tl$T, I, I) , I*i,2) 

FORMAT  USX, 'SUSTENTION* , 17X,F7,2, 6 X,F7, 2) 

WHITE (6, 284) (SUST(tI8T,I,2),I*l ,8) 

FORMAT (20X, ' VOICED' , l7X,P7,a,0X,P7,2) 

WRITE (8, 280) (BUST (LIST# I, 3} , f 0| , 8) 

FORMAT (SOX, >UNV01CE0'<lSX,F7,a,SX,F7(2/) 

WRITE (8, 280) (SIBIL (WIST, I, l),I*l ,8) 

FORMAT U 9X, ' SIBILATION*, 17X,F7*2,0X,F7, 2) 

WHITE (0,284) (SIBIL (LIST, I, 2)  ,I»I ,2) 

WHITE (6, 283) (SIBIL (LI  ST, I, 3)  ,1*1 #2) 
white (0,207) (6R A V (LI  ST,  1,|  ),!•!,  8) 

FORMAT  USX, * GRAVE NESS', ISX, F7«2,SX»P7 ,8) 

-HITE  (0,284) (6RAV(LIST, 1,2) , I»I ,2) 

WK I TE (0 , 263) (GRAV(LIST,I,3),I»I,8) 

WHITE (6, 25  8)  (COMP (LIST, I, 1) ,1*1,2) 

FORMAT  USX, 'COMPACTNESS', 18X.F7, 8, BX,F7, 2) 

WHITE  (0,204) (COrP(LI*T,I,2),I»l,0) 

WHITE (0,288) (COMP (LI ST,  I,  3),  I *1,8) 

IF  ( I PASS, EQ ,2) GOTO  384 
02420,01 16000,014 
CONTINUE 
x*float (numt) 

Y'FLOAT (NUMSUb) 

00  300  L ■ 1 , NUML 
00  300  1*1,2 
DU  300  J • 1 , 3 
2** 

IF(J,GT,1)Z*Y 
w* vUIC (L, I , J) 

VOK(L,I,  J)*CRCT(W,Z) 

W*8UST(L, I, J) 

SUST (L, I , J) *CRCT (W, Z) 

W.GRAVCL, 1, J) 

GNAV(L,I, J)*CRCT(W,Z) 
w*COMP(L, I, J) 

COMP(L,I, J)*CHCT(W,Z) 
w*XNA»AL(L,Ii J) 

XNASAL(L,I,J)*CRCT(W,Z) 

W*SIBIL(L, I, J) 

SIBIL (L, I,J)»CRCT(W,Z) 

CONTINUE 
I P A 8 8 *2 

00  301  LIST*!, NUML 
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W'i!"'  ’’MhMTTlirn*!  f 


I 


i 

t 


I 02420,0)16000,814 

MNXTe(6,seei) 

*HlTE(6,3000)  (ISYSTEd)  , 1*1, S0) 

NNITE(6,302)LIST,  (NAME  (L I ST , J ) , J • 1 , 2 4 ) 

302  fUKMAT(M.13TENER»,I3, ' PERCENT  CORRECT  KITH  GUESSING', 
l ' THAN8FOHNATION(/24Al//) 

GOTO  303 
304  CONTINUE 

301  CONTINUE 

OU  310  I ■ 1 9 , 20 
H«1 

If  (I,tO,20)N«2 
Z*fLOAT(NUNL) 

If d,E8.20)Z*l,0 
OU  310  J ■ 1 , 2 
OU  310  0*1,3 
00  310  1*1, NUML 

V0XC(I,J,N)»V0lC(I,J,lO*V0XCCl.#J#lO««H/2 
XNASAUd, J,4)«*NASAt(I, J,K)**NASACtt#J.N)**N/Z 
JUST  ( I,  J,  0)  »SUST  ( I,  J,K)*SU8TU,  J,  0 )»*M/Z 
8I0It(I,J,K)»SX0Il(I,J,K)4SI01L(L, J,K)**N/2 
GNAV(1, J,0)*GNAVd,J,0)*GRAV(l,J,0)»*M/Z 
C0HP(1,  J,K)  • COMP  (l,J,lO  ♦COMP  U,  J,K)««N/Z 


310  CONTINUE  | 

Z*f LOAT (NUML)  ! 

00  312  J*l,2  I 

00  312  0*1,3  :• 

X*VOIC(20, J,0)  ! 

Y*VUlC(l9# J,K)  i 

VOIC(20,J,K) *SE(X,Y,Z)  j 

X4XNASAU (20, J,0)  * 

Y*XNASAl(19, J,K)  i 

XNASAL(20, J,0)*8E(X, Y , Z J j 


X ■ SUS  T (20, J, A) 

YlSUST (19, J,K) 

$U8T(20,J,N)»SE(X,Y,7) 

X * 3 IB  I L (20 , J i K ) 

Y4010IK10,  J,K> 

S10IU20,  J,A)»SE(X,Y,Z) 

X ■ GH  A y (20,J,K) 

Y4CNAY(19, J,0) 

CNAV(20,J,K)48C(X,Y,Z) 

X«CONP(20, J,0) 

Y*C0MP(l9, J,0) 

C0MH(2«,J,K) •SE(X,V,Z) 

312  CONTINUE 
Z«FL0AT(2*NUNL) 

00  313  J*1 , 3 

00  313  L* 1 , NUNC 
00  313  0*1,2 

V0IC(16,1, J) •V0IC(16,1,J)*V01C(L,K,J)/Z 
XNASAUlS,  l,  J)*XNA8AI(18,  1,  J ) *XN A8AL (l , 0 , JUl 
SuST (16,1,3) •SUST(18, l , J ) *8U8T (L * K» J> / Z 
SIB IL  ( IB, 1 ,J)*8IBIL(18, 1,3) ♦5!BIL(L,B,J)/Z 
GNAV(18,1,J)4GRAV(18,1,J)*6RAV(C,K,J)/Z 
C OHP ( 1 8 , 1 , J ) *CONP ( 1 6 , 1 , J ) *CONP (LiK|J)/Z 

313  CONTINUE 

00  420  Kit ,3 
OU  420  l*  1 » NUML 

VOIC ( 18,2, K) »V0IC (18, 2,(0  ♦(V0IC(t,l,K)*Y0IC(L,8,N))«»2/4, 
XNA8AI(10,2,0)»XNA9aLI)8,2,0}«(XNaBALU,  1 ,K)  4XNASAL  (L,  2 ,K)  ) ••2/4, 
SUST  (18, 2,(0  •SUST(10,2,0)*(SU8T(L,  1 ,0 ) *SUST U . 2, K ) ) * *2/4 , 

SIBIL (10, 2,0) *81811(18, 2,0) ♦ (SIBIL (1,1,8) ♦SIBIL (1,2,10  )»»2/4, 

CHAV (i  6,2,8) •G»AV(18,2,K)4(G8AV(L, 1 ,K)  *GR AV (l , 2, 0 ) ) **2/4 , 
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488  C0HP(ia,i.K;»C0M8(je,2,K)*(C0M^a#i,K)4C0HP(L,8»t())**8/4, 

Z«f LOAT(NUML) 

00  31  1 K » 1 1 3 
X«V0IC(18,2,K) 

Y*V01C(18, l#K) 

V0IC(18,2,X)8SE(X,Y,Z) 

X4XNA8AL(t«,2,K) 

YaXNASALClB, t,K) 

XN*S*L(l8,8,K).3e(X,Y,Z) 

X»S0IT(18,a,K) 

Y'SutYda.i.x) 

SUSTC18,2,K)4St(X,Y,Z) 

XaSIBILC 16, 2,  K) 

Y aS18 IL ( l 8 , 1 , K ) 

8181UlB«2,K)tSC(X#V|Z) 

Xa6RAVC18,2,*) 

Y«0H*V(18i 1#K) 

Ghav(ib,2,k)*SE(x,y,Z) 

XfCONP ( t 8 1 2 # K) 

V»C0«P(1B,1.K) 

C0HP(18,2,Xl*8E(X,Yr2) 

311  CONTINUE 

00  316  L • 1 i NUNL 
00  316. jil,2 
00  316  K«l,2 
Z«FLOAT (6»NU"L) 

If (X,E0.2)Z«1,8 
SUNaVOIC  (L  >3  1 1 ) 

SUH*SUM*XhA3Al (L, J, 1) 

SUNaSUMaSUST  CL# J#  1) 

SUH.8U«*SI61LCL, J,l) 

SUNaSuHa&KAVCL, J,l) 

SUN.8UM*C0NP(L. J,l) 

IP (A.tU.2)SuHa8UN/6,8 
TQTU,tOeSUH««K/Z  •TOT(J,K) 

316  CONYJnuE 

00  868  I I 1 I a 1 # 2 

TUT (3,13 »8,6 

TOT(3,2)a0,0 

62426,01 16088,814 

NH  J T k (6 , 480) NUN L 

NNITt (6,401) ( I8Y8TE (13,141, 88) 

NKITE(6,402)NU«S 
wN 111(6, 981) 

691  fURNAT (' LISTENER  NEAN  ORT') 

00  481  Lil,NUNL 
SUH*0 ,0 

00  962  J * 1 , 2 

SON  • SUN  ♦ VO  I C (L,  J , 1 ) 

SUN  • SUN  ♦ XNASAL  CL , J # 1) 

SUM  • SUN  « 8UST  (L, J, 1 ) 

SUN  a SUN  a SI6iL(L,J,l) 

SUN  l SUN  « OBAV  (L, J , 1 ) 

BUN  i SUN  « CONP  (L , J , 1) 

982  CONTINUE 

X SUN  a SUN/12,8 

WHITE (6, 996) L, X SUN , (NANE(L,J),Jal,24) 

996  P0RNATCI9,F11,2,3X,24AI) 

YUT (3,1)  a TOT ( 3 , l ) * SUN/FtOAT ( NuNL ) / 1 2 ,0 
TOT (3,2)  aT0T(3,2)*(SUN/12,8)a*2 
461  CUN  T 1 NU1 

Z • FLOAT(NUNL) 

X»T0TC3,2) 
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V • TOT (3,|) 

TUT (3,2)  • SE(X,V,Z) 

00  317  J»l,2 
Z»FlOaT(NUML) 

XiTOT ( J , 2) 

V»TOT  ( J , 1 ) 

T0T(J,2)4SE(X,Y,Z) 

CONTINUE 

FORMATPONT  MEANS  AND  STANDARD  ERRORS  FOR  • « 13#  • LISTENERS  ' / ) 

formatpsysteh  under  testi  ' » 0c  a i / ) 

FORMAT P NUMBER  OF  SPEAKERS  *',I2/) 

MR  I TE (6, 403) 

FORMAT (//'MAIN  ATTRIBUTE  P,12X, 'PRESENT' , 1SX, » ABSENT  I , 

12X, 'TOTAL'/) 

MRI TE (8, 404) 

FURHAT(20X,j(4X, 'MEAN  S,E,  ')/)  . . 

MR  I TECS, MBS) ( (VOICCI, J, l) , X«19,2B) ,J»1,2)  , CVOIC (18, 1 , 1 ) , I ■ 1 , 2) 
FORMAT (JX, 'V0ICINS',9X,3C3X,F6,2,8X,FC,2)) 

MNITE(6,400) C(V01CCI,J,2),I»19,2S), J»l,2>, <V0IC(ie,I,2),t»l,2) 
FORMAT (BX, 'FRICTIONAL «X, 3 C3I,FS,2,2X,F6,2)) 

MR  I TE (0, 407} ((VOICCI, J, 3) ,1*19,2#) ,0*1,2) , (VOIC CIS, 1 ,3) , IM ,2) 
FORMAT(SX, 'NON-FRICTIONAL' ,3(3X,F«I2,2X,FS,2)/) 

MR ITE (6,400) ((XNASALCI, J, 1), 1*19,20) ,J»l,2), 
(XNASAL(1S,1,1),I*1,2) 

FORMAT (3X, 'NASALITY ',8X, 3 (3X,F6 ,2,2X,FS, 2)) 

MR  I TE (6, 409) ((XNASALCI, J , 2) , I • 1 9 , 26) ,JM,2), 
(XNASAL(16,I,2),I*t,8) 

FORMAT (6X,'SRAVE',9X,3(3X,F6i2,2X,F6|2)) 

MR1TE(6,410) ((XNASALCI, J, 3), I • 19,29) ,J»1 ,2) , 
(XNA3AL(1B,I,3),1«1,2) 

FORMAT (6X, ' ACUTE ',9X,3(3X, F8, 2, 2X,Ffl, 2)/) 

MR  I TE (6, 4 1 1 ) (CSUSTCI, J, 1) ,1*19,29) , J«l,2) , (BUST ( 10, 1 , 1 ) , I ■ 1 , 2) 
FORMAT (3X, 'SUSTENTION' ,6X, 3 C 3X , F6 , 2 , 2 X , F 6, 2)) 

mRITE(S,412)  C (0U8TCI, J,2) ,1*19,20) ,J»l,2) , (SUST ( 10, 1 , 2) , I * 1 , 2) 
FORMAT (6X , ' ¥ 0 1 CEO ',8X,3(3X,F0,2,2X,F0,2)) 

mR1TE(6,413) ( (SUST ( I , J , 3) , 1*19,20) , J • 1 , 2 ) t (SUST (10, 1 , 3) , I A l , 8) 
FORMAT  tax. 'UN VOICED '.ex. 3 CSX. F0 . 2 . 2X , F0 . 2 ) / ) 


""IICIOHUI  viwunr*,,  »-»■ 

MRITE(0,417)((TOT(I,J),J»l,2),l*t,3) 

F0RmaT(3X, 'TOTALS', 10X,3(3X,F6t2,2X,F0, 2)) 
mHITE(0, 490)  ( TOT ( 3 , J) , J • 1 , 2 ) 

FORMAT (/30X, <•»•»,*.»•••••*•*•'/ 

3MX, '•  MEAN  • ' , F0 , 2, ' *'/ 

jjx, 'TOTAL  ORT  SCORE!  ♦',10X,«»'/ 

J0X,  '•  S,fc,  • ' ,F0,2, ' • '/ 
jmx, '...A***#****.,***'  ) 

NUMTOT  • 1 92 *NUML *NUMS 
mRITE(S,5SS)NUMT0T 

FORMAT (/10X ' TOTAL  NUMBER  OF  TEST  ITEMS  »',I7) 

CONTINUE 

STOP 


i 4*#* 
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3U8R0UT  INt  CHECK(IOVtH) 


T: 


THIS  SUBS  (JUT  I NE  CHECKS  FOR  CORRECT  ENTRY  OF  OAT  A 


L 


r 

I 


i 


DIMENSION  UINtCJJ) 

COMMON  JRtSP  (2« 20) 

01  IP  ASS  • 1 
N*  1 
M»1S 

20  ik iRAss.Eg,2)N»i60M»ae 

' *2400,01 16000,014 

nHI Tt (9, 21) 

21  FORM*! (I8x,  * 1 I, 16X, «?'/) 

no  i i»n,m 

00  3 II  ■ 1,91 

9 LlNEClI)  • ' ' 

IKJRtSP(t,I),E0,2)G0T0  4 
L«9 

IF (INtSP(l,I),Nt.l)t»18 
00  2 J « 1 , L 

2 LlNE(J)  • l*l 

GOTO  b 

4 CONTINUE 

OU  h J ■ 0,19 
o ElNt(J)  ■ 1*1 

5 CONTINUE 

IF  tIRtSP(2, U ,EO,2)GOTO  B 
L *29 

IF  (1RESP(2« I) #N6, 1 )C*91 
OU  7 J ■ 1 0 , L 
7 C 1 NE ( J ) • 'X' 

GOTO  0 

b CONTINUE 

00  IP  J«27,31 

10  UINE(J)  • *X< 

0 CONTINUE 

*N!1E(9,tm,  U1NE(J),JM,9!) 

It  F0RHAT(SX,I2,5X,91An 

1 CONTINUE 
rRITECS, 12) 

12  FURMATt/lIF  OK  ENTER  0 ' ) 

RtAOCb, 13) IANS 
19  FORMAT(U) 

IF  ( IANS,EU,0)GOTO  14 
90  NW I TE (9 , 19) 

15  FuRHATl/'ROH  AMO  COLUMN  TO  CHANGE  ? ENTER  000  TO  CHANGE  ENTIRE', 
l ' PAGE • t 1 RRC') 

Rt  AO  (t>,  16)  INOm,  I COL 
IF (1R0H,EU,B9)RETURN  10VER 
IF (1N0N,G1 ,20) GOTO  90 
IF  1 lROw.LT , 1 ) GOTO  90 
IFUCl'L.GT  ,2)G0T0  90 
IF  (ICUL.I.T.DGOTO  90 

16  FuRMAV (12,  1 1 ) 

NRITE(S,17) 

17  F0KM4T(/<NEn  ENTRY*'/'  R'T 
RtAOO,  13)  IRESPUCOL* IRON) 
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10  FEB  70 

DIAGNOSTIC  RHYNE  TEST  SCORING  N/CARTR 1DGE  INPUT 
C3P-30  implementation 

FUR  INFORNATION  CONCERNING  THIS  PROGRAH  CONTACTS 

CAPTAIN  STEVEN  MEISTER 
ESD/HCE 

HANSCON  AFB,  HA  01731 
TELEPHONE! 

CONN,  (617)  861*4433 
AUTQVQN  470*4433 


COMMON  ANN ay (60) , 1SYS(5U) , NAME (11 ,24) , NP AGE ( 7 , 2 , 3 ) , 
l 0ATAU1,7,36),NSPR(H,6) 

DIMENSION  St  NO (6 ) 

MH I IE (9,30) 

90  FORMAT (////20X, 'ORT  CARTRIDGE  OATA  CHECKOUT'// 

1 ' INSERT  CARTRIDGE  IN  UPPER  DECK  '// 

1 'I/O  mESET  . CONTINUE'/) 

PAUSE 

READ (7, 75) (lSYS(I), I»l,90),NUHL,NUHS 
/ 3 FUnMAT (S0A1 , 213) 

1 FuNMAl (5BA1//INUMBER  LISTENERS  • ', 13/ ' NUMBER  SPEAKERS  *',I3//) 

' 02420,(1116*1(90,014 

DU  2 LIST  ■ l.NUML 
HtA0(/,3) (NAHt(LlST,l ),!•!, 24) 

3 F UR H A I (2441) 

OU  4 1SPK  * 1 , MUMS 

MHlTE (6, 300 ) 

900  FUNMAIC  ') 

UNITE  (0,1)  (ISYS(I) ,I»l,S«)fNUHL,NUHS 
RtAO(/,30)MSPK(LlST,  ISPK) 

30  F OHMa  T ( A2 ) 

HtA0(7,3) (( (NPAGE(I,J,K),I*l,7),J*l,2),K»t,3) 

9 FUNMAT(13) 

HNllfc(6,4U) (NAME (LIST, I) ,I«i,24) ,MSPK (LIST, ISPK) 

40  FORMAT (9X,  20 ('•'), 10X,6('*'),/ 

1 ' L I ST  t NtN ! ' , 24 A l , ' • SPEAKER!  *',IX,A2,'  «•/ 

1 9X,2e(i*'),10X,6('*'),// 

1 *NUMbt«  OF  INCORRECT  RESPONSES!'//) 

OU  20  1*1,6 
OU  22  K«t, 3 
00  41  J • 1 , 2 
L » 6*I*Jt2*K»8 
NT 0 T • 16 
IF(K,NE,1)NT0T*8 
61  TOT  * FLOAT (NTOT) 

OAT A (LI  ST, 13PK,L) »(2t0*FLOAT(NPAGE(I,J,K) ) * TOT ) • 1 00 , / T OT 
NP  ALE ( 1 , J , K ) » NTOT-NPAGE  (1, J,K) 

41  CONTINUE 

22  CONTINUE 

20  CONTINUE 

MNITE(6,276) 

NNlTt (6,277)  (NPAGECt, J,l) , J*J,2) 

MN IT E (6,278)  (NPAGt (1, J,2)  ,J*l,2) 
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WRITE  (6,270) (NRACE(1,J,9), Ja*,8) 

WRITE  (6,806)  (NRAGE(2, J, l), J*l ,2) 

WRITE(8,281) (NRAGE(2,J,8),  Jil,2) 

WRITE  (6,862) (nPACE (8, J , 3)  , Ja 1 , 8) 

WRITE  (6,285) (NRAGE (3, J , 1 ) , Jt 1 , 2) 

WRITE  (6,284) (NRAGE (3, J,2),J«1,8) 

WRITE (6,289) (NRAGE (3, J , 3) , Jf 1 , 2) 

WRITE (6,286) (NRAGE (4, j , 1 ) , Jt \ , 2) 

WRITE (6,284) (NR AGE (4, J , 2) , J» I , 2) 

WRITE (6,289) (NR AGE (4, J , 3) , J* 1 , 8) 

WRITE (6, 287) (NR AGE (9, J , 1 ) , J* 1 , 2) 

WRITE (6, 284) (NR AGE (9, J,2), J»i ,2) 

WRITE  (6,289)  <NRAGE<9,  J,3),JM,8) 

WRITE (6,288) (NRAGE (6, J , 1 ) , Jf ) , 2) 

WRITE (6,284) (NRAGE (6,J,2),J>i,2) 

WRITE (6,289) (NRAGE <6, J, 9), Jt l, 2) 

82420.8116808.014 

21  7ORMAT(10I, 19,5X, 19) 

4 CONTINUE 

2 CONTINUE 

00  280  L 1ST • 1 , N1JRI 

02428.8116808.014 
WRITE (6,900) 

WRITE (6, 1) (lS¥S(I),lwl,90),NUMU,NUH9 
WRITE  (6,201)  (NAME  ((.1ST,  I)  ,I>1 ,24) 

281  FORMAT (l3X,27('a')/'FQR  LISTENER!  ',24Al,i  *1/ 

1 lJX, 27 ('•')// 

1 t SPkR  SCORE'/) 

00  204  I 9RKH • 1 , NUNS 
SUN  ■ 8,0 
00  202  lwi,91,6 

282  SUN  a SUN  ♦ 0 AT A (LIST , I SRKR, I } ♦ OAT A (LIST , ISRKR , J ) 
SUN  a SUN/12,0 

nRITE(8,209)NSPK(LIST,ISRKR),SUN 
289  FORnaT(jx,A2,1X,F7,2) 

204  CONTINUE 

wR I TE (6 , 403) 

WR I TE (6 , 404 ) 

OU  200  1-1,6 
280  SENO(l)i0,0 

DO  210  1 a 1 , 99 , 2 
J«I*l 

00  211  W • 1 # NURS 

211  AKRAY(K)aoATA(LlST,H,I) 

CALL  STAT8(NUN8,X,S) 

SEND  ( 1 ) t X 

SEND (2) a8 
00  212  K a 1 , NUNS 

212  AHRAT(K)tOATA(LlST,K,J) 

CALL  STAT3(NUR8,X,S) 

SEND (9)  a X 

SEND (4)  • 3 
00  219  K«1,NUH8 

219  ARRAY(K)w(ARRAV(K)*DATA(LIST,K,X))/3,0 

CALL  STATS(NUH8,X,S) 

SEND  (9) aX 
SENO  (6) aS 
CALL  QUT(!,SEND) 

210  CONTINUE 

00  819  Kal, NUNS 
SUN  a 8,0 
00  214  la  1 , 31 , 6 

214  SUN  a SUN  ♦ 0 AT  A (LIST  , K , I ) 
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2 1 5 ARRAY(A)  ■ SUM/6,0 
Call  stats(nu«5,*,5) 

StNOU)** 

seno(2)*s 

nu  216  A* 1 , HUMS 
sum  ■ k),e 
CO  2(7  1*2(32(6 

21/  SUM  * SUM  ♦ DaTACL1ST(K(1) 

216  AKRAY(K)  ■ SUM/6,2 
CALL  ST  ATS ( NUM3, X i S) 

StNO(S)  • X 

8 t NU (41  * 9 
DU  219  K»1,NUmS 
SUM  • 0,0 

00  218  1*1(31(6 
J • 1*1 

218  SUM  • SUM  ♦ OATa(LIST,K, 1)  ♦ OAT  A (LIST , K , J ) 

219  ARRAY(K)  * SUM/12, 8 
CALL  STATS(NUM3, X, S) 

StNU(S)  • X 
SCN0(6)  ■ S 

CALL  UUT (36, SEND) 
wKITE(6,490)X,S 
200  CONTlNut 

DU  300  ISPKR  ■ 1 , NUM S 
02420,0116000,014 
UM 1 TE  16, 600) 

MNITEC6, 1) (lSTS(l) , 1*1,90) (NUML.NUMS 
WH1 TE(6,30l)MSPK (I, ISP AH) 

301  FORMAT (12X, •*•*•*' /'FOR  SPEAKER  I ',*2,'  •*/ 

1 12* , !•••*« ' //'LISTENER', 18X, »SCORE'/> 

OU  304  LIST  • l.NUML 
SUM  • 0,0 
DO  302  1*1,31(6 
J * 1 ♦ 1 

302  sum  • SUM*0aTa(l13T,ISPKR,:)*DATA(L1ST(1SPak,J) 
SUM  * SUM/12,0 

WHITE (6, 303) (NAME (LIST, L)(L* 1,20 ,SUM 

303  FORMAT (24A1 ,F7, 2) 

304  CONTINUE 

HR  I TE  16, 403) 

MN 1 1 E (6 , 404) 

DO  310  1*1,39,2 
J ■ X ♦ l 

00  311  K ■ 1 , N UHL 

311  AHHAV(K)*UATA(K,ISPKR,I} 

CALL  STATS(NUML,X,S) 

StNU(l)** 

SfcNO (2) *S 
00  312  K*1,NUML 

312  AKRAY(K)*UATA(K,:SPKR,J) 

CALL  STAT8(NUML,X,S) 

SEND (3) *X 

SEND  (4) *S 
DU  313  K*1,NUML 

313  ARRAY(K)  • ( AHRAY (K) «OATA (K, 1SPKR, 1) ) /2,0 
CALL  STATS(NUML,X,S) 

SEND  (3) *X 
9t NO (6) *8 
CALL  OUT ( 1 • SEND ) 

310  CONTINUE 

OU  313  A*1,NUML 
Sum  • 0,0 
00  314  1*1,31,6 
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014  sun  • Sljn  ♦ UATA(K, ISPKR, 1} 

015  aRHAY(K)  ( SUM/6,  Id 
CALL  STATS  (NUML , X,  S) 

SENU ( 1 ) • X 

SEND (2) *S 
00  016  Mai, NUML 
SUM  * 0,0 
OU  017  :>2,02,6 

017  SUM  * SUn*OATA(K,lSPKR,l) 

016  AMAAV(K) iSUM/6,0 
CALL  STATS(NUnL|X,S) 

SEND (0) »X 

SEND ( 4) a S 
OU  010  A a 1 , NUML 
SUM  a0,0 
OU  Ole  lal,0t,6 
jal*i 

o lb  SUM  a SUM*UATA(K,  ISPKHi I)*0ATA(K« I 3PKH , J ) 

01W  ARRAYS) aSUM/12,0 

CALL  STATS (NUML  # X , S) 

StN0(5) ■* 

SEND (6) aS 

CALL  UUt (06, StND) 

MHtTEl6,4»0)X,S 
OM0  CONTINUE 

» 02420,01 16000,014 

UHl  1116,500) 

MN  1 I L 16 , 1 ) ( I S Y S 1 U , I * 1 i 50 ) , NUML , MUMS 
MMlTt (6, 320) 

020  FORMAT ( 'COMBINED  RESULTS  • STANDARD  ERRORS  ACROSS 

1 'SPEAHtNS  ANU  LISTENERS  **•##*•✓/) 
mH I TE (6 , 403 ) 

MR  I T E (6 , 404) 

NUMT  a NUML«NUMS 
DU  021  ;al,]S,2 
J ■ I * 1 

OU  022  Mat, NUML 
OU  022  L »1,NUMS 
MaNUMS* (*• 1 ) *L 
022  ARRAY (M) aOAT A (M,L, I) 

CALL  STAT5(nUMT,X,3) 

StNU (1 ) a* 

3tN0(2) aS 
OU  020  Ka  J , NUML 
OU  020  Lai, NUMS 
RaNUMS* (K-l  1 «L 

020  akRay ( m ) a DAT  A (N , L) J) 

CALL  STATS(NUMT,X,S) 

StNO(O) a* 

SENO(A) aS 
Ou  024  K a 1 , NUML 
OU  024  ual,NUMS 
M»NUMS* (K«l ) *L 

SUM  a DATA(K,L<1)*0ATA(K,L,J) 

024  ANRAY (M) aSUM/2,0 

CALL  STATS(NUMT,X,S) 

StNO (5) *X 
SbN0(6) aS 
CALL  UUT ( 1 , SEND) 

021  CUNTINUE 

00  025  Mai, NUML 
00  025  Ls>*NUMS 
HaNJMS* (MM ) *L 
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sum  « «(e 
oo  see  i • i , 3 1 » 6 
at  sum  • sum*oata(k,l,  i) 

385  ARRAY (M) .SUM/6,0 

CALL  STATS(NUMT , X,  S) 

StNDU).X 
StND (2) *S 
00  327  K«l,NUMl 
00  327  L*  1 , NUMS 
M«NUM3»(K*1) *L 
suM«o,e 

00  328  I*2,32#6 
,>28  SUM  . SUM  ♦ 0 AT  A (K , L » 1 ) 

327  ARRAY(H)»SUN/6,0 

CALL  3TATS(NUMT,X,S) 

SEND (J) iX 
SEND (4) »$ 

0U  338  *«1«NUNL 
00  338  L»1#NUM8 
M.NUMS* (K*l ) *L 
SUM. 0,0 

00  331  1.1,31,6 
J.IM 

i 31  SUM  • SUM*DATA(K,L* I)*QATA(K,L, J) 

338  ARRAY (M) .SUM/12,0 

CALL  STATS (NUMT , X , S) 

StNO (9) .X 
SkNO (0) *3 
CALL  OUT (30, SEND) 

MHlTE(6, 400 ) X , S 
02420,01 10000,014 
MR  ITS (0, 580) 

MR  It  t (0, 1) (ISYS(l), 1 .1 , 50) , NUML , MUMS 
DO  78  I«1,NUML 
00  70  J.l.NOMS 

m«ITE(0,71) <0aTA(I,J,K),K«1,36) 

71  FORMAT (/C6(2X,ri0, 2))) 

70  CONTINUE 

8 T OR 

27b  FORmAT(10X, *MAlN  ATTRIBUTED,^!, 'PRESENT', 7X, 'ABSENT'//) 

277  FORMAT (15X, ' VOICING ',23X, 12,1 l X , I 2 ) 

278  FORMAT (20X, 'FRICTIONAL' , 16X, 12, It  X, 12) 

276  FORMAT (20X, 'NON "FRICTIONAL*, 12X, 12, 11X, 12/) 

28m  FORMAT  ( 1 5X,  'NASALITY',22X,I2,HX,I2) 

281  FORMAT (20X, 'GRAVE ',2 IX, 12,1 IX,  12) 

282  FORMAT (20X, ' ACUTE* ,21X, 12, l IX, 12/) 

28 J FORMAT (15x, 'SUSTENTION' ,20X, 12, 11 X, 12) 

284  FORMAT (20X, • VOICED' ,20X, 12, 11X, 12) 

283  FORMAT (20X, » UN VO  1 CEO ' , l 8 X , 1 2 , 1 1 X , 1 2 / ) 

280  FORMAT (13X, ' SIBILATION' ,20X, 12, I IX, 12) 

267  FORMAT (15X, ' UR AVENE SS ', « IX, 12, 1 IX, 12) 

268  FORMAT (ISx, ' COMPACTNESS ',19X, 12,1 IX, 12) 

408  FORMAT CORT  MEANS  ANO  STANDARD  ERRORS  FOR', 13,'  LISTENERS'/) 

401  FORMAT ( 'SYSTEM  UNDER  TESTl  ',S0At/) 

402  FORMAT ( 'NUMBER  UF  SPEAKERS  *',I2/) 

403  P0HMAT(//'MAIN  ATTRIBUTED, 12X, 'PRESENT', 10X, 'ABSENT', 


1 12X, 'TOTAL'/) 

404  FORMAT (20X,  3 (4X,  'MEAN  S,E,  ')/) 
460  FORMA  T ( / 30X  , 

I 38X , « * MEAN  * ' ,F0,2, ' . '/ 

1 UX, 'TOTAL  DRT  3C0REI  »',13X,'.'/ 

1 38X,  ' * 8,E,  • ' , F0,2, ' • '/ 

I S0X, '•*•*.*•***••*••••') 

ENO 
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SUBRQUT I NE  STATS <N, XHEAN, STOEHR) 


CUNHUN  ARRAY (60) 

X *0 « 0 

XN  . AUUAT(N) 

OU  1 1*1, R 

X ■ i * ARRAY ( I ) 

CUNI iNUt 
xmEan  ■ tn n 
STDERR  * 0,0 
OU  2 1*1, N 

8T0ER*  « STOfcHR  « (ARHAY(I)*XHEAN)*(ARRAYU)*XMEAN) 
STDtWR  » SORT (STDERR/XN/XN) 

RtlURN 

EnU 


SUBROUTINE  UUT(N,X) 

0 IMtNS I UN  X 1 6 ) 

IF (N , Eq , 38) GOT  U 19 
K*(n*1)/2 
IF  (A.EQ.  1 1)R*8 
IF (A,EQ.1*)K*8 

if  (a, to,  i/)x*e 

IF (A,EQ,I2)X«» 

IF (A,EQ,1S)X*9 
IF(X,EQ,18)K*0 
IF  (X.EQ^IS)**!! 

IF  (A,tU.  16)X*1? 

GUTD[l,2,3,4,3,6,7,8,b,l0,ld,l6) , K 
WRITE  (6, 40S)  <XU),I*1,6) 

RETURN 

WRITE (6, 406) (X(1),I*1,6) 

RtTURN 

wKITE(6,407) (XU), 1*1,6) 

RETURN 

WR  I T E 1 6 , 488 ) IXU)  , 1*1  ,6) 

RETURN 

wrITE(8,409)  (XU), 1*1, 6) 

HtTUNN 

WRITE16,410) (X(I),I*1,6) 

RtTURN 

WRITE  (6, 411)  (XU), 1*1,6} 

RETURN 

WRIT£(6,412)  (XU), !•!,«) 

RETURN 

WHITE(6,4U)  (XU), 1*1, 6) 

return 

WRITE  (6,414)  (XU), 1*1, 6) 

RETURN 

WRIT£(6,41S)  (XU), 1*1,6) 


137 


fctlUftN 

lf>  "RITE (6,418)  (XCI>»X»l,6) 

«fcT  JSN 

19  "KITE (6,417)  ( X C X ) , 1*1,6) 

RttjRN 

405  TUKHit lit,  'VOICING' ,9X,3(3X,F6,8»2X,F6, 2)) 

400  FURflAll6*,'FRlCTI0NAL',4X,3(3X,F6,2,2X,F6,2)) 

40/  FOR t (6X, • nQN«FRICTI0NAL'»3(3X,F'6«2»2X,F6»2)/) 

40H  FURNA.  (3x.  » NASALITY ',I*X,  3 (3*,F6, 2,2*,  F8,2)) 

40v  FUHMAf(6X,'(>HAVt'#9X,3(3X,F6,2,2X»F6,2)) 

4(0  FORMAT (6X, 'ACUTE' ,9X,3(3X,F6, 2, 2X,F6,2)F) 

411  F OKMAl  ( JX , • SUSTtNT ION' ,6X ,3(3  F 6 , 2 , 2 X * F 6 . 2 ) ) 

412  fOKM*T(6X#iVUlCtU,,0X,3(3x,F6.2,2X,F0,2)) 

415  FuKMA 1 (OX, <UNV01CtU*,6X, J(3X,F6,2,2X.F6,2)/) 

41  a HirmrT (3X, ' SIBILATION' , 0*,3(3X, F«.2, 2 »,F6, 2)) 

415  FOHNAl  (3X,  'uRxVENtSSi,7X,3(3X,F6,2,2X,F6,2)) 

410  FuMM*T(3X,'COHRACTNtSS',5x,3(3X,F6,2,2X,F6t2)) 

41/  FjWnrT  (3X,  * TOT  A(.S  ' , 10X,  3 ( JX  , F6 , 2 « 2 X ,F6,2)  ) 

t NO 
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DIAGNOSTIC  RHYME  TEST 


LISTENER  SUMMARIES! 
SAMPLE  test  run 


LlSTtNER  J SPEAKER  KEY 

DOE,  JOHN 

BV  1028 

JE  1 13 A 

NUMBER  OR  COKRtCT  NESPCJNStSI 

MAIN  ATTRIBUTE! 

PRESENT 

ABSENT 

VOICING 

32,00 

20,00 

FRICTIONAL 

16,00 

13,00 

NON-FRICTICNA1. 

16,00 

16, 00 

nasality 

31,00 

30,00 

Grave 

16,00 

19,00 

ACUTE 

15,00 

19,00 

SUSTENTION 

24,00 

25,00 

VOICED 

13,00 

11,00 

UNVOICEO 

11,00 

14,00 

SIBILATION 

31,00 

31,00 

VOICED 

15,00 

16,00 

UNVOICED 

16,00 

>5,00 

GHAVENESS 

25,00 

20,00 

VOICED 

15,00 

16,00 

UNVOICED 

00,09 

13,00 

COMPACTNESS 

32,00 

20,00 

VO  1 CEO 

16,00 

14,00 

UNVOICEO 

16,00 

19,00 
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SAMPLE  TEST  RUN 


LlSTtNEM  1 SPEAKER  KEY  JONES,  ROBERT 

**V  l Id 2 U 

Jt  U3A 

NUMBER  QF  CONNECT  RESPONSES  I 


MAIN  ATTRIBUTE! 


PRESENT 


VOICING 

FRICTIONAL 
NUN. FRICTIONAL 


32,00 

10.00 

10,00 


nasality 

CRAVE 

ACUTE 


32,00 

16,00 

16,00 


SUSTENTION 

VOICED 

UNVUICEO 


29,00 

11,00 

14,00 


SIBILATION 

VOICED 

UNVOICtO 


26,00 

14,00 

14,00 


CNAVENtSS 

VOICCO 

UNVOICED 


31,00 
10,00 
IS, 00 


compactness 

VOICED 

UNVOICEO 


32,00 

16,00 

10,00 


ABSENT 


30,06 

16,00 

14.00 

31.00 

19.00 

16.00 

20.00 

12,00 

14.00 

32.00 

16.00 
16,00 

29.00 

10,00 

13.00 

32.00 

16.00 
16,00 
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SAHPLt  TtSt  RUN 

HSltNtW  1 PERCENT  CORRECT  *» I TH  GUESS1NI,  TRANSFORMATION 
Out , JOHN 


ATTRlBuTEl 

PRESENT 

ABSENT 

VOICING 

frictional 

099. SB 
099.99 

01,29 

62,30 

non»frictional 

099,99 

099,99 

nasality 

93,79 

07,90 

grave 

099,99 

87,30 

ACUTE 

87,50 

87,30 

SUSTt  NT! ON 

90,00 

90,29 

voiced 

82,90 

37,90 

unvuiceu 

37,90 

79,00 

SIBILATION 

93,73 

93,75 

VOICED 

87,90 

009,99 

UNVOICED 

099,99 

07,30 

ORAVENESS 

38,29 

01,23 

voiced 

87,90 

099,99 

UNVOICED 

29,00 

62,30 

COHRACTNtSS 

099,99 

81,23 

VO I CEO 

099,99 

79,00 

UNVOICED 

099,99 

07,90 
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SAMPLE  ust  run 

LIStENEN  2 PERCENT  CORRECT  »ITH  GUESSING  TRANSFORMATION 
JUNES,  ROBERT 


MAIN  ATTR1BUTEI 

PRESENT 

ABSENT 

VOICING 

•99,98 

97,30 

FRICTIONAL 

•99,99 

099,99 

NON«F  R ICTION AL 

•99,99 

73, 0« 

te*  - 

NASALITY 

•99,99 

93,73 

GRAVE 

•99,99 

97,39 

ACUTE 

•99,99 

•99,99 

SUSTENTION 

Jl,» 

• 2,30 

VOICED 

3?,69 

30 ,0* 

UNVOICED 

73,00 

73,00 

sibilation 

73,90 

• 99,99 

VOICED 

79,90 

•09,99 

i 

UNVOICED 

73,00 

099,99 

CRAVENESS 

93,76 

01,29 

VOICED 

•99,99 

•99,99 

UNVOICED 

• 7,60 

92,30 

COMPACTNESS 

•99,99 

099,99 

p 

VOICED 

•99,99 

000,99 

unvoiced 

•99,99 

099,99 

! 

i 

i 

i 
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DhT  MEANS  and  STANDARD  ERH0RS  FOR  2 LISTENERS 


STSlEh  UNDER  TESTT  SAMPLE  TEST  RUN 
NuNoER  OF  SPEAKERS  « 2 


LXSiENEK 

t 

2 


MEAN  uRT 

SI, 25  OOt,  JOHN 

6 7,50  J ONES  i ROBtRT 


MAIN  ATTRIBUTE!  PRESENT  ABSENT  TOTAL 


MEAN 

S.E, 

MEAN 

S.E, 

MEAN 

S.E. 

VUIC1NU 

E RllT 1UNAL 
NUN-fRlCTlONAL 

M9B.SU 

099,90 

*99,99 

0,00 

0,00 

0,00 

84,37 

61,25 

87,50 

2.21 

13,26 

8,84 

02,19 

00,62 

93,75 

1,10 

6.63 

4,42 

NASAL  1 1 V 

ON  AVE 

acute 

96,87 

099,99 

93,75 

2,21 

0,00 

4.42 

90,82 

87,50 

93,75 

2,21 

0,00 

4,42 

03,75 

93,75 

93,75 

2,21 

0,00 

4,42 

SUSTtNI ION 

VU I CEO 

UNVUlLtU 

93.12 

30,00 

96,25 

2.21 

6,04 

13.26 

59,37 

43,75 

75,00 

2,21 

4,42 

0,00 

56,25 

46,87 

05,62 

2,21 

2,21 

6,b3 

SIBILATION 

VOICED 

UNVUlCfcU 

S'*, 37 
81,25 
87.9B 

8,63 

4.42 

8,84 

90,87 

099,99 

93,75 

2,21 

0,00 

4,42 

90,62 

90,62 

90,62 

2,21 

2,21 

2,21 

k*R  AVtNtSa 

VUlCtU 

UNVUlCfcU 

75,89 

93.75 

50,25 

13,26 

4.42 

22,10 

01,25 

009,99 

82,50 

8,00 

0,00 

0,00 

70,12 

96,87 

59,37 

6,63 

2,21 

11.05 

LOMPaC 1 NESS 

VOICED 

UNVOICED 

099,00 

099,90 

099,99 

0,00 

0,00 

0,00 

90,62 

07,90 

93,79 

8,63 

8,04 

4,42 

95,31 

93,75 

90,67 

3,31 

4,42 

2,21 

totals 

84,00 

1,04 

03, 96 

2,30 

04,37 

2,21 

• MEAN  ■ 

04,37  « 

TOTAL  ORT  SCORE!  • * 

• 8,£,  ■ 2,21  * 


TOTAL  NUMBER  OF  TEST  ITEMS  » 70S 
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UKt  means  *NU  STANOaRO  errors  for  s listeners 
SrsitH  uNUfcH  TESTI  SAMPLE  TEST  RUN 
Number  OP  SHE AKtRS  » 2 

L1MENEK  MEAN  D«T 

1 61,25  UOE i JOHN 

2 07,50  JONES,  ROBERT 


MAIN  ATTRJHUTtl 


PRESENT 


ABSENT 


TOTAL 


MEAN 

S,E, 

MEAN 

3.C. 

MEAN 

s,e, 

VOICING 

Pn  I C T ION AL 

NUN-f H1LT10NAL 

099, BB 

099.00 

009.00 

6 , B V 

0,00 

0,00 

04,37 

SI, 29 
87,90 

2,21 

13,28 

8,04 

92,19 

90,02 

93,70 

l.ie 

6,63 

4,42 

NASAL  I 1 T 

GNAVt 

ALU  TL 

06,67 

099,09 

94,75 

2,21 
0,00 
«. <2 

90,82 

8 7,90 
83,79 

2,21 

0,80 

4,42 

93,75 

83,75 

93,79 

2,21 

8,00 

4,42 

SUSTtNt 1UN 

VUILtu 

UNVUlLtU 

93,12 

SM.ae 

96,29 

2,21 

8,84 

13,28 

98,37 

43,79 

79,00 

2,21 

4,42 

0,00 

90,25 

40,87 

09,02 

2,21 

2,21 

0,63 

SldlLAIlUN 

vuicto 

UNVUlLtU 

BA,  3/ 
81,29 
87,50 

6,65 

A, 42 
8,84 

89,87 

089,08 

83,79 

2,21 

0,00 

4,42 

98,62 

90,62 

90,62 

2.21 

2,21 

2,21 

OKAVLNESS 

vuicto 

UNVUiCEU 

75,00 

04,75 

56.25 

13,26 

4,42 

22,10 

01,29 

099,99 

82,90 

0,00 

0,00 

0,00 

70,12 

96,07 

59,37 

6,63 

2,21 

11,09 

L0MHACTNL5S 

VUICtL) 

UNVUlLtU 

009,00 

009.99 

098.99 

0,80 

0,00 

0.00 

90,82 

07,80 

83,75 

6,63 

8,84 

4,42 

96,31 

93,79 

96,87 

3,31 

4,42 

2,21 

lUTALS 

BA.9» 

0,00 

03,89 

0,00 

84,37 

2,21 

iotal  urt 

SCORE  1 

• MEAN  ■ 

A 

• *,E,  ■ 

04,37  * 

♦ 

2,21  « 

1 U T »L  NUMBER 

Ot  TEST 

ITEMS  • 

768 

SAMPLE  TEST  RUN 

NUMBER  LISTENERS  • 8 

NUMBER  3PEAKEN8  • 2 


LISTEnEHI  DUE , JOHN 


* SPEAKER | • BV  * 


[ K NUMBER  op  incorrect 


RESPONSES! 


HAIN  ATTRIBUTEl 


VOICING 

PRICTIONAL 

NON-PHICTIONAL 

NASALITY 

(•RAVE 

ACUTE 

SUSTENTION 

VOICED 

UNVOICE!} 

SIBILATION 

VOICED 

UNVOICED 

0RAVENE8S 

VOICED 

UNVOJCEO 

COMPACTNESS 

VOICED 

UNVOICEO 


PRESENT 


ABSENT 

a 

2 

e 


1*15 


IlillKWllilTJIP  0 l.llillElliMB 


SAMPLt  TEST  RUN 

NUMBER  LISTENERS  • 2 

NUMBER  SPEAKERS  * 2 


LISTENER!  DUE,  JOHN  • SPEAKER  I * JE  • 

NUMBER  OE  INCORRECT  RESPONSES! 

MAIN  ATTRIBUTE!  PRESENT 


VOICING  0 

FRICTIONAL  0 

NON-ERICTIONAt  0 

NASALITY  0 

grave  0 

ACUTE  B 

SUSTENTION  3 

VOICED  l 

UNVOICED  2 

SIBILATION  0 

vuiceo  e 

UNVOICED  B 

GRAVENESS  3 

VOICED  0 

UNVOICED  3 

COMPACTNESS  0 

VUlCED  0 

UNVOICED  0 


ABSENT 


1 

1 

0 

6 

0 

0 

4 

4 

0 

e 

0 

0 

i 

0 

1 

0 

0 

0 


SAMPtt  test  run 

NUNdtR  LISTENERS  » 2 

NUMBER  SPEAnEHS  « 2 


LISIEnERI  JONtS,  ROBERT 


NUMBER  UF  INCORRECT  RESP0NSESI 


MAIN  ATTRIBUTE! 


* SPEAKER | • BV  • 


PRESENT 


ABSENT 


VOICING 

FRICTIONAL 
NUN-f HJCTIONAL 

NASALITV 

Grave 

ACUTE 

SUSTENTION 

VOICEU 

UNVOICED 

SIBILATION 

VOICED 

UNVOICED 

CR  a v t NESS 

VOICED 

UNVOICED 

COMPACTNESS 

VOICED 

UNVOICED 


"Malawi n jd'41l  J VllmJ  li  iHa  i i tofctimli k k A^suamJ mmm HikcafcdfcH  at  m, -“■mmaHHl  tilt  •*■-*"**•• 1 «»«w*wia«  »iirm tntfi  n i th 


sample  test  run 

NUMBER  LISTENERS  « 2 

NUMBER  SPEAKERS  ■ 2 


LISTENER!  JONES*  ROBERT  • SPEAKER  I * JE  • 


NUMBER  OF  INCORRECT  RESPONSES! 


MAIN  ATTRIBUTE! 

PRESENT 

ABSENT 

VOICING 

e 

2 

FRICTIONAL 

a 

a 

NON>FR!CT!ONAL 

a 

2 

nasality 

V 

l 

GRAVE 

B 

l 

ACUTE 

a 

a 

SUSTENTION 

4 

2 

VOICEO 

2 

2 

unvoiceo 

2 

a 

SIBILATION 

2 

• 

VOICEO 

a 

a 

UNVOICEO 

2 

a 

GRAVENESS 

I 

l 

VOICEO 

• 

a 

UNVOICEO 

W 

i 

COMPACTNESS 

• 

a 

VOICEO 

9 

a 

UNVOICEO 

a 

a 

SAMPLE  TEST  RUN 

NUMBER  LISTENERS  • 
NUMBER  SPEAKERS  • 


PON  IISTENER1  OOE#  JOHN 


SPAN  SCONE 

bv  75, tit 
JE  87,38 


MAIN  ATTRIBUTE! 


PRESENT 


ABSENT 


TOTAL 


MEAN 

S,E, 

MEAN 

Ul 

• 

40 

MEAN 

VOICING 

PI  ILTIONAL 

NUN»f NlCTlONAL 

009,99 

099,99 

099,99 

0,00 

9.08 

0,08 

81,23 

62,30 

009,99 

4,42 

8,64 

8,88 

98.62 

81,28 

899,99 

2,21 

4.42 

8,88 

NASALITT 

GRAVE 

ACUTE 

93,73 

099,99 

67,30 

4,42 

0,08 

8,64 

87,38 

87,30 

07,50 

8,84 

8,84 

0,84 

98,62 

93,75 

87,38 

6,83 

4,42 

8,84 

SUSTtNTION 

VOICED 

UN VOILEO 

30,00 

62.30 

37.30 

8,84 

8,84 

8,84 

36,23 

97,58 

73,08 

4.42 

26,32 

17,66 

33,1? 

38 ,8C 
36,25 

2,21 

8,84 

13,26 

SIBILATION 

VOICED 

UNVOICED 

93,73 

87,30 

099,99 

4.42 

8,84 

0,00 

99,73 

099,99 

87,38 

4.42 

8,80 

8,84 

93,73 

93.75 

03.75 

4,42 

4.42 

4.42 

UHAVtNESS 

VOICED 

UNVUICEU 

36,23 

87,30 

23,00 

4.42 

8,84 

8,00 

01,23 

099,99 

62,38 

4,42 

8,88 

8,84 

66,73 

03.73 

43.73 

4,42 

4*4? 

4,42 

COMPACTNESS 

VOICED 

UNVUICEU 

899,99 

099,99 

099,90 

0,00 

0,00 

0,00 

81,23 

73,88 

07,30 

13,26 

17,68 

6,64 

96,62 

87,36 

93,75 

6,63 

8,64 

4,42 

TOTALS 

82,29 

3,68 

88,21 

3,16 

81,23 

4,42 

• MEAN  * 81,23  • 

TOTAL  pRT  SCORE  I • • 

• 8 ,E , • 4,42  * 


.LJLMlk.:^,uilOlllllLllUUtUi:ililN^iSJJi  ,iEi,IIM::illiyull!lllllB[J!llWIK&ttU)IJltU)liu  A 


SAMPLE  TEST  RUN 

NuNBEH  LISTENERS  t 8 
NUMBER  SRE AKfeHS  « 2 


Fun  LISTENER!  JONES*  ROBERT  * 


Snan 

SLONt 

bv 

80,34 

JE 

46. 46 

MAtN 

aTTRIBUTEi 

PRESENT 

ABSENT 

TOTAL 

MEAN 

S.E. 

MEAN 

S.E, 

MEAN 

8.E. 

VOICING 

FnICUONAC 

NON«F  H I C T I OnAL 

090,09 

099,90 

•99,90 

0,09 

0,00 

0,00 

87,30 

•99,99 

78,00 

8,84 

0,00 

17,68 

93,73 

099,99 

07,90 

4,42 

0,08 

8.84 

NASALI 1 Y 

GRAVE 

ACUTE 

•99,99 

999,99 

999,99 

0,00 

0.00 

0,00 

93,73 

87,30 

099,99 

4,42 

8,84 

0,00 

96,67 

93,73 

090,09 

2,21 

4.42 

0,08 

3USTENTIUN 

votcto 

UNVU  it.E0 

36,23 

37,39 

73,90 

4,42 

0,64 

17,68 

82,80 

80,90 

78,00 

8,84 

0,00 

17.68 

89,37 

43,73 

78,00 

2,21 

4,42 

0,Ut 

SIBILATION 

VOICtU 

UNVOICED 

73,09 

73,90 

73,00 

0,00 

17,60 

17,00 

099,99 

099,99 

099,99 

0,00 

0,00 

0,00 

87,90 

87,30 

87,30 

8,00 

8,84 

8,84 

GNAVENtSS 

VUlLEU 

UNVOICED 

93,73 
099,99 
B7 , 30 

4,42 

0,00 

0,04 

81,28 

099,99 

88,39 

<.42 

0,00 

8,84 

87,30 

090,99 

73,00 

0.00 

0,09 

0,08 

COMPACTNESS 

VOICED 

UNVOICED 

099,99 
BOB, 99 
999,99 

0,00 

0,00 

0,00 

099,99 

•99,99 

099,99 

0,00 

0,00 

0,00 

099,99 

099,99 

099,99 

0,00 

0,09 

0.00 

TOTALS 

87,39 

I.<7 

• 7,80 

0,00 

07,90 

0,74 

• MEAN  * §7 , SB  * 

TOTAL  OR i SCORE  I • « 

• 3,t , • 0,74  • 


•*p%,-w«|n'  viMdppu,- 


SAMPLE  TEST  RUN 

Number  listeners  * 8 
NUMBER  SPEAKERS  • 8 


pur  speaker  i ev  • 


r LISTENER  SCORE 

t 

‘ ODE,  JOHN  79,38 

JUNES,  ROBERT  88,54 


Main  »ttributei  present  absent  total 


MEAN 

8.E, 

MEAN 

S , E , 

MEAN 

S.E, 

’ . 

VOICING 

899,98 

8,88 

67,58 

6,84 

93,75 

4,42 

frictional 

899,99 

8,88 

75,88 

17,68 

87,39 

8,84 

NUN-FRICTIONAL 

899,99 

8,88 

899,99 

8,68 

899,99 

0.08 

; j 

nasality 

93,73 

4,42 

87,38 

6.64 

98,62 

8,63 

OravE 

899,99 

8,88 

67,58 

6,84 

93,73 

4,42 

ACUTE 

87,38 

8,84 

67,58 

8,64 

87,30 

8.64 

SUSTENTION 

38,88 

8,84 

56,23 

4,«2 

53,12 

2,21 

i 

VOICEO 

37,38 

8,84 

62.58 

6,84 

38,88 

6,64 

\ 

UNVOICEO 

62,58 

26,52 

38.88 

8,88 

56,23 

13,26 

* i 

SIBILATION 

81,25 

4.42 

93,73 

4,42 

87,38 

8,00 

5 •; 

VOICEO 

62,68 

8,64 

899,99 

8,88 

61,25 

4,42 

UNVU1CEU 

899,99 

e,ee 

87,58 

6,84 

93,75 

4,42 

URAVENtSS 

79,88 

17,66 

73,86 

8,88 

76,80 

6,64 

VOICEO 

87,38 

6,84 

899,99 

8,18 

93,75 

4.42 

UNVOICEU 

62,58 

26,52 

58,88 

8,88 

36,25 

13,26 

j - 

compactness 

899,99 

8,88 

61,23 

IS, 26 

98,62 

6,63 

VOICEO 

899,99 

6,88 

79,88 

17,68 

67,30 

6.64 

UNVOICEU 

899,99 

8,88 

67,98 

8,84 

93,75 

4,42 

TOTALS 

83,33 

4,42 

68,21 

3,16 

81,77 

4,79 

• MEAN  • 

81,77  * 

TOTAL  ORT  SCOREI  • • 

• S,E,  • 4,79  • 


» 

fit 


ji"lli  :.Ji,  i .iJjJjlllllLut. nJ,  itJk -ilHlJI 


SAMPLE  TEST  RUN 

number  listeners  * 2 

NUMBER  SPEAKERS  ■ 8 


FOR  SREAKtRl  JE  • 

LISTENER 

OUt  , JOHN 

JUNfcS,  ROBERT 

HAIM  ATTRIBUTE! 

SCORE 

87,90 

86,46 

PRESENT 

ABSENT 

TOTAL 

MEAN 

S.E, 

MEAN 

s.t. 

mean 

S.E. 

VOICING 

899,  Bfl 

8,88 

91,25 

4,42 

98,62 

2,21 

FRICTIONAL 

899,99 

8,88 

87,98 

8,64 

93,7* 

4.42 

NQN-FRICTIONAL 

099,99 

8,88 

76,88 

17,68 

87,98 

6,64 

NASALITY 

899,99 

8,88 

93,73 

4,42 

96,67 

2,21 

GRAVE 

899,99 

8,80 

87,58 

6,64 

93.73 

4,42 

ACUTE 

899,99 

8,80 

889,99 

6,80 

009,99 

8,00 

SUSTENTION 

96,89 

8,42 

62,98 

6,84 

99,37 

2.21 

VUICEO 

62,58 

8,64 

28,88 

17,60 

43,73 

4,4? 

UNVOICtU 

98.88 

8,80 

899,99 

8,60 

75.88 

0,00 

SIBILATION 

67,98 

0,84 

899,99 

0,80 

93,76 

4,42 

VOICED 

899,99 

8,88 

•99,99 

6,00 

099,99 

0,08 

UNVUICEU 

79,88 

17,88 

• 99,99 

0,00 

87, 3B 

8,84 

URAvENtSS 

79,88 

6,64 

87,58 

0.00 

61,25 

4,42 

VOICED 

899,99 

8,80 

890,99 

8,60 

009,99 

0,00 

UNVOICED 

98,88 

17,66 

75,08 

0,80 

62,30 

8,04 

COMPACTNtSS 

899,99 

8,68 

899,99 

6.66 

899,09 

6,86 

voictu 

899,99 

e,ee 

•99,99 

8,80 

899,99 

0,00 

UNVUlCtU 

899,99 

8,88 

899,99 

8,80 

000,99 

0.00 

TOTALS 

96,46 

8,74 

87,68 

8,80 

96,94 

0,37 

• MEAN  » 86,98  • 

TOTAL  DRT  SCORE  I • • 

• 5,C,  « 8,37  • 


52 


5!fiP  ■ n^fr' 


SAMPLE  TEST  RUN 

NUNSEh  LISTENERS  ■ 2 

NUMBER  SPtAHtHS  ■ S 

CUMBlNEO  RESULTS  • STANDARD  ERRORS  ACROSS  SPEAKERS  ANO  LISTENERS 


MAIN  ATTRIBUTE) 


PRESENT 


ABSENT 


TOTAL 


MEAN 

S.E, 

MEAN 

S.E. 

MEAN 

S.E. 

V0IC1NL 

C9S | 09 

0,00 

84,37 

9,18 

92,19 

2,99 

FRICTIONAL 

099«99 

0,01 

St, 29 

10,36 

90,62 

9,18 

NON-f HICTIONAL 

•99,99 

0,00 

87,80 

10,03 

93,79 

3,41 

NASALITY 

96,87 

2 

90,02 

3,18 

93,75 

3,83 

OHAyE 

099,99 

0,00 

87,80 

0,23 

93.79 

3,12 

ACUTE 

93,78 

9,41 

03,79 

5.«l 

93,73 

9,41 

SUSTENTION 

93.12 

9. IS 

99,37 

9,10 

30,29 

2,21 

7' 

VOICED 

5u.ee 

0,84 

43,79 

13,62 

46, S7 

3,18 

UNVUICEO 

96,25 

13,62 

79,00 

12,90 

03,62 

8,12 

SIBILATION 

04,37 

9, IS 

96,07 

2.71 

90,62 

Z.M 

VUlLtU 

81.29 

10,36 

•99,99 

0.00 

90,62 

3,i8 

UNVUICEU 

87,90 

10, S3 

93,79 

9,41 

90,62 

3,18 

CRAVENtSS 

79,00 

9, as 

61,29 

3,12 

70.12 

3,18 

- 

vuictu 

93,79 

5.41 

099,99 

0,00 

96,67 

2,71 

UNVUICEU 

96,29 

10.24 

02,50 

0.29 

89,37 

9,12 

LORPACTNtSS 

099,99 

0,00 

90,62 

a, 12 

98,31 

4.0C 

VO  ILtU 

099,99 

0,00 

07,90 

10,83 

93. '3 

3,41 

UNVUICEU 

099,99 

0,00 

93,79 

9,41 

96,67 

2,71 

* 

TOTALS 

84,90 

2,37 

83,89 

3,16 

84,37 

2,73 

* 

* 

1 

» MEAN  • 

84,37  • 

r- 

TOTAL  d«t 

9COREI  < 

» 

• 

i 

1 ».E,  * 

2,73  # 

153 


i 


i 


••  S8X.11H  V03  ** 
••  RSX.11M  V73  •* 
R5X.11M  V03  M 
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X 
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• • 
• ■ 


77077  TTTTT  N 


7 

7 

7777 

7 

7 

7 


N 

NN 


N N N 
N ‘NN 
H N 


I I 

II 

II 

II 

I 


l 7777 


11 

1 

1 

1 

1 

1 1 1 


11 

1 

I 

1 

1 

111 


*♦ 

"IX.llM 

ves 

• * 

2t.M4R.7S 

13147199 

0701  (200,700)XXX,7TNJ17| 

• t 

eix. 1 1 m 

V83 

♦ ♦ 

21.N4R.70 

13147150 

0701  (207, tea) XXX, f TNI  171 

• # 

esx.tiH 

V03 

• • 

21.M4R.78 

13147150 

0701 (000,200) XXX,7TN|17I 

i 
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DIMENSION  I6ITS(|8),IPACK(4) 

DIMENSION  IS VS (4) , INOLST <4),ISPK (2 ) , IL ISTN (4) , 
menu  (94) ,ICOL9(29) 

0 1 BEN  8 1 ON  t E QU IV (74) 

DIMENSION  I ALPM (26) 

DIMENSION  NL  XO  (23)  .JESS  (93)  ,X£VNfl2)  ,8CVL  (19)  ,XSPK|(1S) 
DIMENSION  88889(12) , NAME (4), LS VS (2)  , I HE  40(30) 

EQUIVALENCE  (IRECNO , IEQUI V ( | ) ) , (IPflND, IEQUIV (9)5  , 
X(1SV8(1),1EQUXV(3)),  (I  MOL  ST  ( 1 ), IEQU1 V (7 ) ) , (1888  (t).IEQUIV(tl))< 
X(IL18TN(l),IFQuIV(l3)),  (ICOLHU  . IEQi'IV  ( 1 7) ) , ( IC0L9 ( 1 ) , 1EOUIV < 46) 
COM MON/PaGE/IP AQE(46, 94) 

COMMON/EPBOPS/IANANT(94) 

DATA  NHAX/74/ 

DATA  XftlTS/"!  ,*2,*4,M«,  •28,M0,«10P,  "280,  M0t, " I 008, 

X"9PPP, »4PPP, "10000, "9PPPP, "4PPPP, *108000/ 

DATA  NAMEO)  ,NAMr  (2)  .NAME  (S)>AME(4)/SMZ,,8,N,8/ 

OATA  NAMEC/9HC./ 

DATA  K | J A,K l 1P|MASK,HA9K 1 , IBLNM 
E/»tI4»P|IS,»S97,«77,*H  / 

DATA  IONO#E*ISTAPT,I8TOP,IOPOP, XENOPL 
X/"  100800, "I 000  01 , " 1 00002, " 1 P8B0  3 . *1PPPiP/ 

OATA  XALPM(1),!AIPMCP),IALPN<3) , IALPN (4) , IALPH(5) , 

X XALPM(S) ,tAl  PN(T) ,1ALPM(S) ,IALPH(9),XALPM(JH)  , 

X XALPN(»n,IAtPMC|2),!AlPN<i3>;iALPHM4),!AlPM(lS),XAlPM!6), 

X IALPN a 7) .XALPHf IP) , I ALP* (14). IALPN (20) , IALPN (9t) . XALPH (89), 

X IALPN (83), IALPN (94) . I ALPM (23). 1 ALPM (26) 

X /1NA#  1NB,  1MC,  lHO.lNE,  tMp#  1KJ,  J NJ,  JMR,  JML,  1MM,  JMN, 

X 1H0.IMP.IMQ, 1NN.IHS.1NT. IMU.IHV, 1NN.1MX.1NT, JMX/ 

DATA  NlIO 

X/89.P13P,  9339,8993, 1 277 , 4096 , 9834 , *687 , 3343,51 64. 1 529, 7 1 2 1 .>199# 

X 8*46, 7 398, 2296. 9406, 9463, 9397,8 176,9343, 48 49,6804/ 

DO  99  88*1,38 
XNEAO (88) *IBLNK 
1 E8P (88  ) •• 1 
DO  49  8*1,94 
IANANT (85  *0 
PB0P8P*  l 
MSPSM. 

I»ECN0*8 
1 DPQN0*8 

ipttpi.i 

CALL  A8SI0N(3, 'OP3I ') 

CALL  ASS!GN(4, 'LP8I ') 

CALL  A88IQN(9, 'Til  I) 

CALL  ASSIQN(8, 'Til •] 

MITE  (6, 1 97) 

POP mat (/ins, 'ENTEP  DATE  OP  TEST  DD*MNM«TT  (1BM0V.77)  I*) 

HE AO (9, 371) (INE AD (88), 88a |, 9) 

POPMAT ( 4A2 , A 1 ) 

MP1TE (8,879) (1NEA0(88),88*1,8) 

POPMAT  (IX,  ' THIS  IS  MNAT  YOU  SAID*.,',  ', 442,41) 

MITE  (0, 1 90) 

POPMAT  (/IX, '(NTEP  MEAOCP  INTO, . ,A8P') 

PEAD(5,tl9) (INEAD(88),88aS,30) 

POPNA-T  (29Af ) 

POPMAT(IJ) 

MITE (8,199) 

POPMAT(//lX,  ••••COPT  TO  DISXf.'.TVPC  0 POP  NO,  I POP  TES») 
PEA0(9,191) XPOPlt 


Sfr 


1 

| 


193  FOKHAT  f//lK,  i*«*COPY  TO  PRINTERt’.  .TYPE  0 POR  NOl  1 POR  YES') 
REaO(9,109)IPOPLP 

199  porhatixe) 

XR(M«I 
mttTii 
lmiTimir 
NRITE (9i  199) 

190  P0RHAT(/1X, 'ENTER  RLI8TENERi,R8PEAKER$,*8Y8TEN.  ,121214 ' , 

X/IX,  'POP  EXANPLEI089S1104  POLLOnEO  BY  CARRIAGE  RETURN') 
READ(9.a02)NL,N8,L8YS(1) .L9Y8C2) 

291  PO*MAT(X0,18.42,A2) 

NANt (2) aLBVS (2) 
oecooe(«.i99PiL8Y»)x»T8 
1998  PORHAT  f 4 X 1 ) 

XPCPOPll.EO.nCALL  ASSIGN f 3. NAME) 

00  31 R K»l,NS 
NRXTE(a.B93)K 

203  PORN AT (IX, 'ENTER  KEY  AND  SPEAKER  (E ,G( 1 1P2S6V)  POR  SPEAKER  * « 19) 

REA0(9,294)KEYN(K) ,KEYL(K) ,K8PKt (K),K8PK2(K) 

294  P0RN»T(I3,A1.A1(A1T 

3 10  CONTINUE 

NRITE (0,808) (KEYN(K),KEYL(K).KBPK1 (K) ,KSPK8(K) ,K»l ,N8) 

299  PORNAT(///i¥. 'CHECK  THE  KEYS  MX,  13,  Ai , AJ , Al)  ) 

PAUSE  ••••*•  READY  TO  GO 
KLCTRR0 

c 

1 CONTINUE 
CALL  ROPAOE 

C 

1091  CONTINUE 

IRECNO.IRECNO*! 

C 

IPONORi 
00  2 K • 1 , 4 

IP  f IP  AGE  M ,K*9P)'.E0,1)IPCN0.IPGN0*K 

2 CONTINUE 

IP (lPGNO.EQ.R)NRITE (9.2003 

200  P0RH*T(1X, 'EOP.  ENTER  P TO  GO  OR  1 TO  STOP') 
lP(IPONO'.EO,P)»EAn(9,t9nl8K 
IPfIPGN0',GT,4)PAli8E  'RAO  PAGE#  .PIXARESUME  ' 

IP(IPQNO.GT,4)GO  TO  1 

1P{({  18H'  ANO'.ll  .fT.n.ANO.IPGNO.CO.PDOO  TO  9999 
IP(IPGNO.EOffl)GO  TO  1 
IPHRCST'.EO,  UOO  TO  2J 

IP((nPGN0.I0PGN0)'.E0,1)  .OR.f  (IPGNO.XOPGNO).EO.-3))GO  TO  21 
IPdPONO'.EO,  TOPGNO)00  TO  22 
NRITE (8, 108) 1UP0N0, IPGNO 

19«  PORHAT  MX,  * 8E0UENCE  ERROR  PS  ',11,'  TO  Ml) 

pause  'load  right  page.resuhe' 

00  TO  70P3 
22  CONTINUE 

471  PORHAT (IX, '00  YOU  NANT  TO  END  THE  RUNT  0»N,1»Y') 

NRITE  (9, 104) 

NR!TE(8,471) 

READ (9, 191) IQPlQ 
IP(IOPLO.EO,nGO  TO  9900 
104  PORHATOX, 'REOIINOANT  PAGE  IGNONSO, , , ' ) 

GO  TO  70P3 
21  CONTINUE 

IRESTnP 
XOPGNOalPONO 
IP (IPONO, NE, 1)00  TO  41 


1 b 8 


c 

-KCCTMKICTIU1 

C 

!0$YS*itmfi*!sv8(i)*ine*isv8(9)*in*isv8(3)*!(vs(4) 

C 

1TE MR.MOD(0LCTR.l  , NS)41 

JNDL8T  (n.4£YN(iTEMR)/l00 

lNOLSTf2)4NOD((4EYN(tT£MP)/j0),j|!) 

InOLST  (3) .MOO  (0£vn(IT£MP1  , i A1 
I MOIST  f 4).0EYL(ITEMP)  .ANO.MAS01 
C 

:0Ht!8*iA8*IMUL8T(n«18*:HnL8T£S)*!H0LST(3) 

c 

00  3909  40*1  . 4 
JLISTN(00).0 
DO  3002  1(11,10 

IF(IRACC(444<1,043«)  ,EQ‘.  n XLISTV(K0).0»1 
3002  CONTINUE 

IOLIS.l»0fl#ILlSTN(l)4100.:LlSTN(2)*j0«ILI5TN(3)4lLI3TN(4) 

c 

c 

1 8R4  f 1 ) <0SR0 1 (ITEMP) .AND. MA341 
I3P0  f 2 3 40SP0R  (1TEMP)  . ANO'.NASXl 
C 

c 

9l«0  Continue 

ITEHP«NLIO(n*l 

00  0110  40«2.IT£MP 
IF  (IDLIS'.  EQ,NLXO(K0))GO  TO  9200 
9110  CONTINUE 

n«ITE (8,01001 IDUIS 

0190  F0RmaT(/ix, 'HEAOER  ERROR",  B *0  LISTENER  10  '.J4/1X, 

X 1 ENTER  CORRECTED  10...  EXAMPLE  1 3693 ' 3 
READ (3, 90931  ( IL ISTN ( ITEMP) , I TEMP* 1 .4) 

9093  F0RHAT(AI11 

inLl801000«lLl8TN(i)*ifl0«lul8TN(?l*l0»ILlSTN(3l*lLlSTN(4l 
CO  TO  9100 
9280  CONTINUE 

IF(IERR(44),LT,0)IERfi(04)0P 

C 

41  CONTINUE 

C 

00  3 KK«t ,20 

1 Sum ■ 0 

10  (IPAGE(004l  4,01  ,E9.nl9UM«t3UM.4 
IF (IP AGE (XX* 14,91,00.11  I SUM* I SUM. 3 
IF (JR AGE (40.1  4,l0),.tO,O  TStiR»I8UM.9 
IF (IF ACE (0041 4, U ) .£0.1 ) I SUM. I SUM* 1 
I F ( 1 R ase  (•(!(♦  1 4 , i si Eo , i ) I Sum.  isum*i 
IF ( IR ACE (44414,141 .E0.1 11SUM.ISUM42 
IEMRASE  (0  04  14,10), E0,1  ) I8UM.ISUM4  3 
IF (IRAOE (004  1 4, 16) ,E0,1 ) I SUM. ) SUM. 4 
IF  (I  RACE  (004  1 4,3)  ,f  O'.  1)  I SUM..  I SUM 
IC0L1 (40). MOO  (00,2) 

IF (I8UN.LT.01  IC0L1 (001.0 
IF  (HUM, ST, 01  1C0L  1 (001  «! 

RRSPSaRRSRS. t , 

IF  USUM.NE.eiGO  TO  30 1 
RBDR8P.RB0RSP*!, 

I TEMP.NLTO ( 1 ) * 1 
DO  61  0»2, ITEMP 

lP(I0LI8'.e0,NL!0(4)  1 IERR(0).IERR(4)4l 
8l  CONTINUE 
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CONTINUE 

CONTINUE 


r jp 

r <:• 


i 


sat 

6 

C 


at 

•m 

s 


on 


01 

9? 

93 

94 

7 

C 

7nni 

c 

9 


910 


3701 


3702 


00  6 00*1 ,29 
18UHI0 

IF(IPAGE(O0*l4,39)'»EQ,l)T8UN*I8UN«4 
IF  (1PAQE  (00  41  4,401  , EG.  1)ISUM*  I SUMO 
IF(IPA0E(084t4,4l)  .EQ,1)ISUN*I9UN*2 
IP (IPACE (0041 4,421 .EO,l)!SUNaISUM«l 
IF (IPAGE (80414,44) ,E01l)I8llN»I8UN41 
IF (IF AGE (00414,481 ,EQ , 1 ) ISUM*18UM4? 
IF(IF*GE(004l4,4«).C0,ni8UN»I$UN43 

!F(IF*GE(8  84!4,47)'.E0,lllSUM4lSUM44 

IF (IPAGE (08414.82)  .EO.niSOMa.ISUN 

icou2(ooi«hoo(ok,21 

IF (I$UN,LT,0)ICOL2(8K)*0 
IP(ISUn,GT.P)IC0L2(X8)*i 
RRSPS*RR8Pl4 1 , 

IF  ( ISUN, N£ ,P) GO  TO  801 
RB0«8P»RB0R8P4i , 

ITENP4NLI0(l)4l 
00  82  0»2, ITENP 

IF  (IOLI9.EO.NU 10 (0)) ieR«(01»TEPR(0)4l 

CONTINUE 

CONTINUE 

CONTINUE 


TF(lPPPlP.eO'.0)GCl  TO  7iA«M 

NRITe(4|9fl)IPGNO,lD8V9iI*LPH(I3PO(l)),l4LPH(I8PO(21), 

X!DLlS,I0NLIS.ULPHflN0L9T(4)1 

FORN*T(1M1/30X,3HPAGE  , I 1 , SH  OF  4/ 
r 1 X , SHSYSTFNl  , 14/11, 8H8PEA0RI  ,2X|/1X, 

X8MLI8NERI  ,I4/1X,8HW0LISTI  ,T3.A1/////1 
00  7 oal. 20 

IFMIC0L1  (0)  .Cn.P)  .XNO'  (TC0L9(0)  E0,nnNRlTt  (4,0nK,O 
IF  (1IC0L1 (or.EO.P) .XNO. (1  COL 2(0) .E3,l)1 WRITE (4 ,02)0,0 
IF  ((icon  (*)  .EO.tl'.XNll'  < TCOt  7 (O),,eo,nn  UNITE  (4. 93)0,0 
IF  ( (IC0L1 (0  3 .e0.1).*NO.(ICOL9(K).eo,l))NRITE(4, 94)0,0 
Format (30, I2,3H**«, 1 nx , 4mx  ,180, 4MX  , 1 P X , 3h#4  4 ,12) 
FORMAT (30, I2,3M..., in0.4NX  , I6X.4M 
FORMAT (3X,I?,3M4«*, IPX, 4M  X.18X.4MX 

FORMAT (3x, I2.3H4.4, 1PX.4M  X,  18X,  4M 
CONTINUE 


X,10X.3H*.*,I2) 

, 1PX.3H4*., 12) 
X,1PX,SH444,I2) 


CONTINUE 

CONTINUE 

IF  ( 1 POP  1 1 , NE . t ) GO  TO  7P03 
IF(IFTTPl,E0.n,0R,lIRE8T'. EO,1)GO  TO  #1P 
I F TTF 1 »P 

nRITE(S)NL,NS, (IMEAO(01,0»1,3P) 

NRITE(l)NL,NO, (IMEAD(O) ,0*1 ,3B) 

CONTINUE 

nRITE(3)(IE  .IIV(O)  ,o*i  ,NMAX) 

00  3701  XI! . 

IPACO(8)*0 
00  3702  0*1,3 
00  3702  N8IT*1,  10 

IF  (1E0UIV (104O4N01T) ,N£,P) IPACO (0) iJPACO (0) ,0R . I » ITS (NB I T) 

CONTINUE 

00  3793  0*4,4 

00  3703  N6I Ta 1 , 10 

IF (leoulv (104O4N0IT) .NE.P) IPACO (0) ■ IPACO (0 ) , OR . IBI T8 (NB 1 T) 


j 

■A 

I 

I 


4 


i 
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IP  warn 


BO.  " ' i **  - I-  Jult'ii'-.ui. r Jiiiimi^injj 


3208  CONTINUE 

NRITECt)  ( IEQU  X V (K)  . (!  PACK  00  ,K*1,4) 

c 

7*03  CONTINUE 
C 

60  TO  1 

c 

8680  CONTINUE 

RTE NO a (*§0*80/88808)  * IK*’. 

WR!TE(9,*0§)RBO08P,R*S08,RYEM0, I08Y9 
380  FORMAT  (/ 1 X , l BAO  HARKS, MARKS  % • ,07  ,0, I X.07,0, 1 X.P9,  I / 

MX, I «»**STSTEM  « 1,14) 

ITEMO«NLI0(n*l 

DO  S3  KKaS.ITEMP 

RTENPa ( 1688 (KK ) /8B0880) *)fO, 

IO(IE*8(KK),Ge,0)M8ITE(«,«8t)NLIO(KK) , IER8 (KK ) , 8TEM0 
*81  008 MOT (IK, 'LISTENER  ',I4.9X,I4.'  *88083',**,*  I'.OO.l) 

93  CONTINUE 

N8ITE (0,0800) (MIN8(I*W*NT(K) ,8) ,K«1 ,34) 

8080  0O*NAT(1X, 10(911, IK) ,411) 

9T00  0 In  I SHEO 

END 

0U88OUT I NE  BOOKS* 

C 

CIMEN8I0N  ICON (3) 

COMMON /CMA08/ICNARB (900) 

COMMON / 1 00 age / X *88* Y( 48  88) 

0 AT*  ICOM/»a01 ."009, "021/,ICR/"218/,XEP/"§12/ 

C 

XBASE* ( (( *170300, AND, "727*7) ••00800) /*)♦! 

C 

CALL  M*IT (4, 2, MOUHMV) 

c 

180  CONTINUE 

I*88»V (lB*8E*a)««2l 

! ARRAY (XBASE *0)**2t 
OLOTIM«SFCNO8(0.) 

00  103  K ■ 1 , 3 
101  CONTINUE 

IO((Xa88*V(IBA8E*8)«ANO<"280),NE',  *000)  60  TO  102 
1O((8ECNO8(0,)»OLOTIM)', LT,I,9)G0  TO  101 
N8I TE (0 , 1 0*0 ) 

1808  008M*T (IK, '•••  OMR  NOT  RECEIVING,  YOU  MUST  RESET  OMR,') 

0AU8E  • RES  TO  CONTINUE' 

CO  TO  108 
10*  CONTINUE 

I*88*V (I§*3C«3)*ICflM(K) 

103  CONTINUE 

C 

INKfl 

OLOT I M« SECNOS  (O.) 

*00  CONTINUE 

IO((IA8R*Y(I8A8E*0)  , AND, "208)  ,E0'.  "000)60  TO  300 
XCH*80(INK)»I*R8*Y(X0*3E*1) ,*N0, "377 
TIM|»8ECNO8(0.) 

OLOTIMaTIME 

IE((ICM*R0(In*),EO.IC8)  ,*Nn,(lNX.6T,l)'.*N0'.(TCM*8»(lN*«l) 
X.EO, IEO) ) GO  TO  400 
INKbINK*! 

GO  TO  *00 
300  CONTINUE 

I7((8ECNO8(0.)-OLOTIM)-.Lf,1  l'.)GO  TO  200 
"RITE (9, 1001 ) 
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iwei  P0RMAI(1X,'««*  QMR  NOT  SENDING  EP/CR.  TOU  *UST  RESET  OMR  AND  RE 

XREAO  THe  RASIM 

PAUSE  'RES  TO  CONTINUE' 

SO  TO  188 

408  CONTINUE  

CALL.  3CAN(!ERRES,!N)0 
lEfllRREG.EQ.nGO  TO  108 
return 
END 

SUBROUTINE  SCAN(IERREG.INXT 
0 I PENS 1 On  IBIT$<8) 

C0MNON/CMAR8/ICHARf»(38O) 

COMMON /PaOE/ I PAGE (46 » 34) 

COMMON/ERRORS/IAWANT  (341 

DATA  IOTTS/W48i,,#0l*10«',4j',8i,,t/ 

C 

IVAU(N)*ICMARB(K).AN0,»77 


DO  98  *81.46 
DO  99  KKol.34 
09  IPASE (*,8*1 *P 


C 

JROM t 
NPTR00 

108  CONTINUE 

NPTRtNPTRM 

1F(ICH*RB(NPTB),EG.*01S)GO  TO  900 
IE(NPTR.UT.IN*1G0  to  too 
STOP  'IMPOSSIBLE' 

208  CONTINUE 

rfPTRaNP’R 


281  CONTINUE 

NPTRpHPIRM 

IF(lCMARfl(NPTR),EQ. "9131G0  TO  300 
IFfMPTR.LT.INM00  TO  201 
STOP  'IMPOSSIBLE' 

388  CONTINUE 

N.((HPTR-NPTRl-n/l« 

NPTRpnPTRpI 

00  301  .33*81 ,N 

iTf MP*I VAL (NPTR*1 8*  ( K 0 K • 1 ) I 

IE(ITEMP',GT.I«0N1G0  TO  3001 

IAMANT(IROM*i1*IANANT (IR0M«11p1 

GO  TO  381 
3081  CONTINUE 

IROm ■ I TEMP 
DO  301  *•!  ,9 

00  301  3 K • 1 ,0  . ... 

IE ( ( I BITS (KMT , AND , I CM ARB (MPTR*18* (***•! )♦*) 1 

X IP AGE (IR0M*1 .6*(K»1 )•**) "l 
SOI  CONTINUE 

NPTR»MPTR«1 

IFfMPTR.LT. INX1G0  TO  108 

1 ERR  P G »3 


iNE.OJ 


NROmERpO 
00  481  KalSi 43 
00  408  KKol  , 34 

IF (IPA&e (3, 33) ,10, 1)G0  Tft  481 
488  CONTINUE 

N40nER»NR0WER»1 


401  CONTINUE 

IF  (NSOmER.LE’.  t/RETURN 
MRITE (6# l OOP) NROWER 
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iw'irwfT 


irs*  forhatmx,  *•••  mb,'  nisseo  rfifonk  boms  on  this  pace  , * / 

XIX.  'TYPE  IN  A 1 TO  REREAD  THE  PA  ''.,1'/ 

XI*.  'TYPE  IN  A * TO  ACCEPT  PACE  A3 
READ(S,1P<H)!TCMP 
1MI  FORHaT  Ml) 

IF  { I TEHFlEO(P) RETURN  ^ ^ 

pause  'res  to  continue* 

ICRRPGfl 

RETURN 

End 


*•  rix.iin  ves  •• 
»•  RSX.I1H  V03  •• 
••  RSX.liN  V03  •• 


2t.MAR.78  1 S I 48  ISA 
21.MAR.7B  l 3 I 48  1 34 
21.MAR.7R  13148134 


0781  (200,2001  X8ER',8TN|304 
0801 (200,2001 X8CR,8TN|S04 
0801 {298,2881 X8CR.8TNI394 


x x rrrrr 

x * r 

x x 9 

X 8889 
X X 9 
X X 9 

X X 8 


teeee  « rrr 
e r r 
e r r 

EC((  RRRR 
l 9 9 

l 9 R 

eeeee  r r 


88888  TTTTT  N M 

8 T N N 

8 T NN  n 

8888  T N N N 

8 T N NM 

8 T N N 

8 T N N 


II  95933  898  4 4 

II  9 8 944 

S3S  81  98  4 4 

||  3999  44444 

II  9 90  9 4 

1 5 5 9 8 4 

| 355  999  4 


ft* 

RlX.l 1M 

V93 

• ft 

21.MAR.78 

13148134 

0891 (290,2891 X8|R,RTN|504 

ft# 

R8X.1 1M 

V83 

• ft 

21.MAR.7R 

13148134 

0891 {290,2991 X8CRf8TN|504 

• ft 

RSX.11M 

V03 

• ft 

21.MAR.7i 

13148154 

0801 (200,200] X8ER.8TNIS94 

LOGICAL*  1 KYRAOL.KYGODL 
DIMENSION  1C0UIV(74) 

DIMENSION  NAME t4) ,L3YSf2) .IHEADCSR) iLDFL (8*1 , LSDEL («) 
DIMENSION  ISY3{4),InOLST(4)  , ISPM2)  ,ILISTN(4), 

X ICOL1 (891 1 ICDL2(?9) 

EQUIVALENCE  (IRECNO.IEOUIvnn  . (IPGMD,IEOIiIVf*n  . 

X (isvam  .tEQUiVO)),  flMOLSTtn  ,IF01IIV(7)I  , 

X (I9PXM)aICOUlv(ii))i(ILI8TNrUiICOUlvn3))i 
x (ICOlt  (n.IEOUjV(i7))  t (IC0L8fn.I60UIVf4Bn 
OAT*  NA3K/»377/,MlRP/M00/ 

OAT A IGNORE,  ISTART,  ISTtlP.IDRnP,  IFNDFL 
X /» lCRAP«,"lRBttPl,l'1RPfl«2,*tPB*R31 "1RPPJR/ 

OAT A NAME (1) ,NANf (81 , N ANE ( 3) . N AME t 4 ) /2Mt , , p , 0 , «/ 

c 

CALL  ASSIGN(S.  'DF| i) 

CALL  AS9IGN(4, 'OFt ' ) 

CALL  ASSIGN (s , 'Til') 

CALL  ASSIGN (A,  'Tli  'I 

KCYSAOaP 

IOLlD*« 

ICSP*P 
I 03101*8 
I0SID2aP 
00  in  I Kal.S 
S n 1 LSOEL (K ) a8 

00  1R8  K a l , 20 
ISO  LOEL  f X I »P 
C 

MRITCIA,  19P) 

190  FuRMATf/lx./ 

XIX.'ENTEB  SYSTEM  10  '..'.14') 

RE  AO  (5, 191ILSY8M)  ,L*Y3t2) 

191  FORMAT ( *2, *2) 

NAME(2)*LSV§(2) 

DECODE (4. 199P, L3YS) 1 SYS  ID 
1098  F0BM*Tfl41 

CALL  ASSlGNfS.NAMEl 
BEADfSINL.NS. (IMEA0(K),Kal,3P) 

NRITFfA,  1IIA4)  (IHEaD(K) ,Kal.3P) 

1804  FORMATf/lX.SBAS/) 

NRITF(A,  192) 

102  FORMAT (/IX, 'MON  MANY  LISTENERS  TO  DEI  ETE  ? , 13 ' ) 

BE  AO (9 , 1 93) NOEL 
IBS  F0RMAT(I2) 

MR ITE ( A , 1 79) 

1 7B  FORMATf/lX, 'MON  MANY  SPEAKERS  TO  DELE TE t . , 1 2 ' ) 

REA0(3.  193)NS0EL 
I F (njiCl  ,LE ,P ) 00  TO  3P9 
DO  3PS  Kal.NDEL 
NR  I TE  ( 8 « 194) 

194  F0RMAT(/1X, 'ENTER  LISTENER  ID  TO  0FLETE..I4') 

R t *0 (9 , 193)LDEL(K) 

109  FORmaT(Ia) 

300  CONTINUE 
309  CONTINUE 

if  (nsoel'.le.p)Gc  to  sip 
DO  3P9I  Kaj , nSOEL 
NRITEtO. 19S) 

190  P0R«aT(/1X, 'ENTER  SPEAKER  TO  OELE TF , , , A2 » ) 

READ (9, 189)LS0EL(K) 

109  PORRAT ( A2) 
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continue 

CONTINUE 

NRITEf6,19«) 

FORNATf/lX,  'ENTER  ANT  INCORRECT»CORRECTEO  KEY  PAIR  (I  IF  OR)') 
RE  AD (5 1 107 ) K THAI).  K Y8A0L  .K  T600D.  K VflODL 
♦ ORHATdS,  A1.I3,  A1) 

NLaNL-NOEL 

N9»N».NSnEU 

iFflCSP.EO.lTCAU  CSP10 ft , 1ST  ART  ) 

IOATA«TSvSID. ANO, "ASK 

if ticsp.eo.ncAU-  cspumi.tdata) 

I0ATA«IShFT(ISTSID,«8) 

IFflCSP.EO.nCALl  CSPIOU.tOATA) 

IOATAaNL.ANO.NA9K 
IFflCSP.E'l.nCALL  C9P 10  (1  , 10  AT  A ) 

IDATAaTSHFT  fNL.af) 
iFficsp.ea.nCALL  cspion  .ioatat 
IDATAaN9.AN0.NASK 
if ficsp.eo.nCALL  rspiof i .ioata) 
lOATAafSMFT (NS.-B) 

IFfIC3P.EQ.nCAU  CSPIP  ( 1 , 10ATA) 

00  Sfl  Kai , 3d 
I0ATA1T3NFT  (THE AO  (A) ,.9) 

IFflCSP.EO.nCALl  C9P  Ifl  ( 1 i 1 0 AT  A ) 

1 0 A T A B t ME  AO f K ) .AN0.NA9K 
IFflCSP.EO.nCALL  CSPlO't.IPATA) 

CONTINUE 

IF flCSP.FQ.  11CALL  CSPIOf 1.I9T0P) 

IFfICSP.EO.PiNRITCfA.SPPPIISTSIO.NL.NS. (IMFAO(K) .Kat ,3P) 

I F0RHATfl4,IJ.IS,3«A2) 

CONTINUE 

REA0(3,EN0*9RO) (IEOUIv(K) ,Ntl ,74) 

IF ( IP6N0 . NE , 1 ) OH  TO  i 

ITLinaiPaa«lLl8TN(nat(«P.lLl*TN(?)*i9*lLl3TNf3)aTLI9TNC4) 
UOATA.ISHFTff  f lEOMlVf 12)  , ANO, MASK)  *H  IFF)  ,8)* 

KfflEOUIVfin .AN0.NA3K)*mi«e) 

IF  (NSPEL'.LE.F)CO  TO  tPO 
00  1991  Kali NSOEL 
IFfllOATA.EO.LSOFLfKnGO  TO  1 
l CONT In jE 

CONTINUE 

IF (NOEL  «LE .91  GO  TO  t|1 
00  It  Kai.NOFL 
IF(lTLI0.E0.L0ELfK))50  TO  1 
CONTINUE 
COnTINjF 

IFflTLIO’.NE.IOLIOJCn  TO  31 

CONTINUE 

GO  TO  J? 

CONTINUE 

CONTINUE 

IP(N30EL.LE,9)G0  TO  ?i i 
00  2 1 1 P Ka  1 ,N80ei 
IFfllDATA , EO.LSDFL (K) ) GU  TO  1 
* CONTINUE 
CONTINUE 

IFfNOfcL.LE.PTOG  TO  21F 

00  12  K a 1 .NOEL 

IF f ITLIO.fO.l0EL  fOTGO  TP  1 

Continue 

Contjnuf 
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ip  ucsp.eu.  ijcau  cspmn , istamtj 

00  3 *«|7,74 
tO*T*«!eOUJVfH),*Mfl,M4,4H 

jfucsp.kj. ijcau  cspmn. toataj 

tOATA»ISMFT  {JEUIIIV  f«J  , .PI 

IF  UCSP.F1.J  JCAU  CSP  lH(1  , in AT  A 1 
3 continue 

IF  ( ICSP.FQ.  t JCALL  CSPIM!  , TSTfJPJ 
jp  ncsp.Fu.MjoPjre fA.BPun  f tf  QHivfi' ) ,n«|7.y4j 
spai  roRHiifSPin 
Go  Tn  t 
c 

3)  CONTINUE 

ip  Mesp.ro.  ijcau  cspiou  , tstapij 

1 D A T A ■ 1 TLin.ANO.MAS* 

IF  UCSP.fU.  IJCAlI  CSPmn  , IOATAJ 

IDATA«1SmFT  (!TL10,-HJ 

IP  flrsp.f  0.  J JCAli  CSPmn  , tOATAJ 

ip  nc sp.fo.  n Cali  cspmn  , ist op > 

IP  r irsp.p (j.mjmpit£  f A.flpyj)  in  in 

8PP?  FOPPA  f ( 14 ) 

IOLIIJpJU 10 
CO  TO  21 

c 

32  CONTINUE 

IP  f ICSP.EO.nCAU  CSPmU.fSTAPTJ 
I0ATA«ftFQUlvn2J,AMn,MAX*J*Mli*P 

i»(icsp.po.  ijcau  cspmn  .ioataj 

10  AT  A*  flEOlll  v U n , A Nil,  HASP  J **1  PP 
IPflCSP.FO.lJCALL  CSP 10(1 , TOATAJ 
TIOatabIsmft  ( ( ( i f u 1 1 1 v n ? j .ano.maxfj  ♦ m j Pt'j  f p j ♦ 

* ( (It OUIV  f 1 n . AND. MAS*) *11 APJ 

lAF»M«mn*TP.Oi/Ivf/1*i.i.IF0tilV(*J*It0nTv(9J 

IPUKCVN.EO.KTtUOJKtVtUfJal 

IF  UkEyN’.F  Q.KYRaOJ  IXFYNiKYr.OOO 

InATA»lKFYN.A.'Jn.WASK 

IP ( IC9P.E0. 1JCALL  CSPIOfi , IOATAJ 

IOATA»tSHFT(TKEYN,.0J 

ip  (lcsp.Fg.  ncAu  rspmci , toataj 

I 0 A T A ■ MFQJIvMWT  .ANO.WAXFJbMJPP 
I K F YC • IShF  T ( ( (IEOuIV (|A)  . AND'  MASK ) »Htun J , ,p)« 

X( (IEOUIV  UP) . ANO.NAS« )*M IMP) 

IF(K£TBA(J.E0.1)IPFYL«*Y  6001 
KEYBADPP 

IFUC3P.Fo.nCAu  cspin (i , ioataj 
IPUCSP.eO,  IJCALL  CSPIO  ( 1 , IOATAJ 

if ucsp.Eo.t jcall  cspmn, istop) 
c 
c 

lPUCSP.EO.PJYPITEfA.SPJPJTinATA.lxEVN.IKEYL.lFEYL 

8PIP  FORMAT  (AJ,  13,  A)  , AU 

losiomisPKm 
10SI02»ISP* (?) 

CO  TO  22 
C 

#09  CONTINUE 

ip ucsp.eq. ijcau  cspmn , tendflj 
ip (ICSP.eo. ucall  cspin n , temiflj 

IP  UCSP.E0.PJEN.IF  HE  4 
JFUCSP.EO.aitNOP  UE  4 
STOP 
f NO 


J 
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** 

RSX.1 1 H 

VP3 

♦ # 

21.HAU.7B 

13149120 

OF B|  f2BB,9«*Bl  SCORE  ,FTNf  7 

♦ # 

RSX-1 1* 

V33 

• * 

21-MAP-/B 

13149129 

OFffl | [299,7*91  SC0RF.FTM7 

RSX-1 1 M 

V (*3 

** 

21.HAU.7B 

13140129 

0F9I  f2«(»,?Bl«l  SCORE. FTN»7 

SSSSSSSS 

cccccccc 

nonnnn 

RPRRRPRP 

FEFFFFFFFF 

SSSSSSSS 

cccccccc 

nnnnnn 

RRPRRRWP 

ffef.feeeee 

ss 

cc 

on 

nn 

RW 

RR 

EF 

ss 

cc 

on 

nr 

RR 

RP 

EE 

ss 

cc 

nn 

nn 

RR 

RR 

FE 

ss 

cc 

on 

nn 

WB 

RR 

FE 

ssssss 

cc 

on 

nn 

RPRRRRPP 

EFFEFEFF 

ssssss 

cc 

nn 

nn 

RPRPRPRP 

FEEEFEEE 

ss 

cc 

on 

nn 

RR 

RP 

FE 

ss 

cc 

nn 

no 

RP 

RP 

FE 

ss 

cc 

no 

on 

RP 

PR 

FE 

ss 

cc 

no 

nn 

RR 

PR 

FE 

SSSSSSSS 

cccccccc 

nonnnn 

RR 

PR 

FFFFFFFEEE 

SSSSSSSS 

cccccccc 

onnnnn 

RR 

RR 

fffefefeee 

ffffffffff 

TTTTTTTTTT 

nn 

NN 

nn 

77777777 

fffeffffff 

TTTTTTTTTT 

NM 

NN 

nn 

77777777 

FF 

TT 

UN 

NN 

nn 

77 

FF 

TT 

NN 

NN 

llll 

77 

FF 

TT 

NNNM 

NN 

77 

FF 

TT 

NNNN 

NN 

77 

FFFFFFFF 

TT 

MM 

NN  NN 

nn 

77 

FFFFFFFF 

TT 

NN 

NN  NN 

1 1 n 

77 

FF 

TT 

NN 

NNWN 

i n i 

77 

FF 

TT 

NN 

nnnn 

i n i 

77 

FF 

TT 

NN 

NN 

1 1 

77 

FF 

TT 

NN 

NN 

1 1 

77 

FF 

TT 

NN 

NN 

1 1 

77 

FF 

TT 

MN 

MN 

1 1 

77 

»«  RS».MK  VP3  •• 
♦«  RSX.11M  V*3  *• 
••  RSX.llM  v?3  •• 


91.MAR.7B 
2 1 .MAR-7B 
?1  .MAM-7B 


13149120 

13140120 

13149120 


DFPI  t2Bfl,2t»Bl  3C0»F.rTN»7 

dfoi  9cnoF,rrN|7 

PFfll  fPR»,2RBl SCnRF.FTMf 7 
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c 


c 


1 


c 

c 

r 

c 

r 

c 

c 

c 

c 

r 

r 

c 

r 

c 

r 

c 

r 

r 

c 

c 

r 

r* 

c 

r 

C 

C 

c 

c 

r. 

r 

C 

c 

r. 

r 

r. 

c 

c 

r. 

c 

c 


r 

r 

C 

r 


common/ a / insvs,  tsvs  t*>iM  ,na*e  ri  si  ,np age  17.2. si , 

* MSPK  , MKEY,l.f  TTF.R  ,|  1ST,  ISP*  ,MJML,MI“S,  ARRAY (BA)  , IRESP(?,?91  , 

X0ATaM?,«,3*<) 

Call  assign rs,  in»i*i*>Mt»tv.KFvn 

call  asstgnm,  *om«*  n 

icons* 

r.ONT  TMiit 

CALL  CTL  f |rn«) 

call  srowFftrnp) 
if  nrup.Fo.p)C*u  matr 
Gt>  in  1 
FNO 

subroutine  r.TLfiroMi 


OtAGNOSTTC  WMYUF  Tf  ST  SCORING  PROGRAM 


3 DEC  74 


STfVFN  NFISTFR,  fSn/PCEL.  MANSCOM  AFP,  M A PIJ731 


M.MSMH  a NUMBER  I'F  S'  'BE  E A TtIPF  S CORRECT  EACH  LISTENER 
NuMT  a NUMBER  OF  MAIN  FEATURES  CORRECT  LACK  LISTFNER 
ni/ml  m NUMBER  OF  LTSTENfcPS 
Nl|»S  s N U M B F R OF  SPEAKERS 

list  i current  listener 

ISPkR  « CURRENT  SPEAKER 
IKFV  a CURRENT  KEY  NUMBER 

Nk  F Y 3 CURRENT  KEY  INDEX  NIIMBFR  FOR  KFV  ARRAY 
I PAGE  « PAGE  ME  INC  SrORFO 
IEFAT  3 INDEX  E (ip  MAIN  FEATURE* 

1 * VOICING 
? 3 NASALITY 
3 » SUSTENTION 
£ e SIBILATION 
S 3 GRAVE  NESS 
N c COMPACTNESS 
7 a EXPERIMENTAL 

feature  array  key; 


MAIN  FEATURE 
SUB  FFAT  pres 
3UR  FEAT  APS 


PRFSENT  ABSENT 

a. i,n  a,?. n 
f L * 1 , PI  TL.P.P1 
fL.l.Jl  f L , ? . 31 


L » LISTENER  NUMBER 


Ff.ATf1«,N,H) 
FEATf9(",N,MT 
FEATf IP, 1 ,M) 
FF.*T(|A,7,Hl 


3 MEAN  for  n,m 

3 STAE'OARO  FRROR  FCIR  N,M 
= MEAN  FOR  PRFSFNT  * ABSENT  STATE  OF  M 
* S.E.  FOR  PRFSFNT  * ARSFNT  ST  A TF  OF  M 


1 (i!) 


..'AI.Tl.L 


. . %'*& 


c 

c 

c 

c 

c 

c 

c 

c 


c 

c 


1 

1 


c 

c 

c 

c 

c 

c 


c 

c 

c 


1 

1 


c 


»P3 

man 


c 

c 

c 


1P4 

1*4* 


rib 


c 

c 

c 


1R3R 


Ml 


PAGEII.J.K1  ANO  NPAGFd.J.K)  i 

I ■ feature 

J • 1 I PRF  SENT  2 1 ABSENT 
k ■ iihatn  ?isub  pres  s i sun  ars 


niMENSTON  KEY (5ft)  ,KEYSll8(3ft,?l 
DIMENSION  NE WKF Y ( 3ft , ftp) 


COMMON/ A/IOSVS, ISVSTF(SR) , NAME  f l ST , 

NP  AGE  (7,2,3)  a HSPK(15,0)  ,N*EY,l.FTTER, 

LIST.ISPA.NtlML.MlMR,  ARRAY (ftp^  , I RF SP (7 , 29) , 0 AT A ( l ? , ft , 36 ) 

integer  answer 


OaT  A IaUPHA, IALPHB/2MAA,?HPB/ 

StlR  FEATURES  KEY 

DATA  KEYSIIR/PrR, ), P, l,p,3*l, 3»P, 1,1,5*P,1,P, 1,1, 4*0,1, 3«<», 3*1, 
3»"»1 iP. t #P» 1 ,3«P,7*1 ,o, 1 ,4*P, I ,1 ,R,1 ,p, 1 , J*«, J ,p,l , 3*B,1 , 1 , 
nt t , F, 1 , 1 ,P, 4*1 , 3*P, 1 ,3*(*,3*1 ,P,3*1 ,P,3«t ,P,1 , 1 4*1 / 

RE  AO  l SYSTEM,  NiiMRFR  LISTENERS,  nijmRFR  SPEAKERS 

IF  (ICOH.nE.PIGO  TO  1B40 
LlST.p 

CALL  ASSIGN (fl , * OFn  | < ) 

READ(31NE-KEY 

REAOf 4, 1 P31 ini YS.NUML, NUNS, (ISVSTEdl  ,T»1 ,3F) 

FORMAT (14, 13, 13, 3BA?) 

CONTINUE 

IFf  (LIST*!!  .GT.NliHUGO  TO  ?BR 

LIST«LTST*1 

ISPKbR 

»EAO  LISTENER  10 

READ(4.1P4)NAME(I  1ST  5 
FORMAT  ( I 4 ) 

CONTINUE 

IF  ( (ISPK«i) ,GT.NUMS)GO  TO  tPRB 

ISPK«ISPK*1 

00  RIP  I « 1 , 7 

00  RIP  J»1 ,2 

00  6 1 P K»| ,3 

NPAGE (I « J,  K ) • P 

REAP  SPEAKER  NAME,  KEY  NUMBER  ANO  LETTFR 

RE  AO (4, 1P3P)MSPK (LIST, ISPK) ,NKFV,LFTTER 
FORMAT  f A?, T3, A?) 

MkEY  » NKEY 
00  RPJ  K K ■ 1 P? , JPR 
If  (NK E Y , NE , KK ) GO  TO  RPt 
naFY.?*(kk«1P2)*1 

GO  TO  ISP 
CONTINUE 
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nnnn  no  or>r>  n n n r»r»o 


807  IF  (NKEY.NE  .1  1 nGO  TO  HP* 

NKEYolS 
GO  TO  150 

80S  IF  (NKEY.NE. 1 1 2)  GO  Tn  HP!> 

NKFYol 7 
GO  TO  15ft 

809  IF(NKEY,N£,1  1 3)G0  Tl)  *1W 

NKEYbIQ 
GO  TO  15P 

8tO  IF(NKEY.NE.1l3)G0  TO  *11 

NKEY«7l 
GO  TO  ISO 

8 1 t IF(NKfv.NF.11fl1GO  TO  *12 

NKFY»73 
GO  TO  ISP 

812  IF(NKEY,r,T.3l8)Gfl  TO  1«1 

IF (NKEY.LE.3PH1G0  TO  151 
NK£Y*?5*7*(NKfcY«3Pl1 
GO  TO  150 

1 50  IF (LETTEB.Nf. lALFHBJGO  TO  1501 

NKfYiNKEYAl 

GO  TO  152 

1501  IFfLFTTFB.FO.tFI.PHAinn  TO  157 

151  w»l IF (5, 300) NKEy.LETTEW 

300  FO(JM*T  (///•-  ******  NO  KFY  «.I3,Ai,'  .*«***'///1 

STOP 

152  CONTINUE 


DO  1527  K ■ 1 | 58 
1527  KEY (K  1 ■ NF  WK  E V f* , MK  f Y ) 


DO  no  IPAGE  • 1,4 

PE  AO  current  pagf 

106  HEAD  (4, 107) f (IRE SP firm  , T«nwl , IRON ■ 1 . 29 1 , ICOL ■ 1 , 7) 


107  FORMAT (5*1 1 1 

00  203  IC0l«1 ,2 
00  204  IRON  12,72 

C ESTABLISH  Ff ATllHF  BEING  SCORFO 

IF  f IRON , I F.H1 I FEAT* IRON- 1 
ITFMP  oIHOw.1 

IFEAT«M00(ITFMP,7) 

IF (IFEAT.EQ.O) IFF AT«7 

C ESTABLISH  WHICH  (OI.IIHN  PRESENT  STATE  OF  FEATURE  IS  IN, 

IPRESi 1 

IF (IPAGE. LF.7)IPPES»P 
C FIND  KEY  ELEMENT 

KEYtL»I1f'W 

IF(IC0L,EG.?1KFVFL«IR0wa?9 
INOF*  • 7 

IF  (IPAGE. EG,  1 )GOT[)  20h 
IF  (IPAGE’.EO.SIGOTO  ?9« 
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IFfKfTfXFyFH .Ng.JPRf SVlWnS*«» 

GOTO  299 

29*  IF  (KF»  f«ETEU  ,f  0.IPRFS1  lNQFXit 
C Iwijex  «1  IMPLIES  main  FEAtURF  PRFSFMTi  2 IMPUFS  ABSENT, 

C SCURF  Trtf  RESPONSE 

249  ANSWER  • P 

irnp*0£.EO,i)r,nTo  29s 
I F f I PAGE'.  EG,  31  GOTO  295 

if  fsEvfirFvtn .NE.iPtr.pnrot, troph  anspfb»i 

GOTO  29S 

295  IF  fs£»f«ETEL1  .EO.lRESPf  IMl.  . T PORT  1 ANShFR ■ 1 

296  CONTINUE 

IF  (IF6iT.EO.nf.nTn  257 
I SllBPt? 
n S 1 1 H P * 2 

IF  (IPAGE.EO.niSllHPPl 
IF  f 1 PAGE  . FO, 31  TSlI'IPal 
IF  (KEVRUP  ( HE  VF.l. , I SliHPl  .E0.P1  N Si 'HP  a 3 
r,l>TU(PSt  , ?5.',2S3.?SA,2S5.2S«T  , IFF  AT 

251  NPAGF  M . TnOFv  , inPAGE  M . iFiOFX.  1 1 ♦ANShFR 
NPAGFM.T  NOEX  .N.SHHP1  «NpAGF(11lNnExlNSHMP)*ANSRF» 

GOTO  26 A 

252  NO  A&f  (?,  TNOF  V , 11  »NPAr.F'  f ?,  I»iOF  X,  11  ♦ANSwFN 

NPAGE  (2,  IN'IET.NSliPPI  «nP  AGf  f2,  I MU  X,nSUBP)*ANSpFB 
GOTO  26v 

253  NPAGf IS, TnOFx, i ) • UP AGE  IS, IwnFX , u *«FR 

NP  Af.F  (3,  I NfTF  X,  wStiHP)  tNPAGE  f 3 , IM1F  * ...r.uRPl  ♦ ANSWER 
GOTO  76V 

26  4 NP  A GF  ( 4,  T NOE  X,  n * NPAGF  ( «.  t “OF  X.  11  ♦A'ASNF  R 

Np  AGE  (4,  Tn|>FT  ,USi>HP)  PNPAf.F  f 4 . INUF  * .nSijBP)  *ANSnF« 

GOTO  76? 

255  NH  AGE  15,  t NOEx,  11  aNPAGF.  f5,  UOF  X. ) 1 ♦ AnSnFH 

NP  Al.F  (5,  TNOE*,nS"HP)  «NpAGt  f 5.  INUF  X ,NSl,RP)  *ANSnFB 

GOTO  ?6? 

256  NPA(«F(5,tN0Fx,1TiNPAGF.  f6,I»l6F»,n*ANS*«FN 

NP  A(,f  (5,  INPEX,  NSHHP1  4NPAGE  (6.  I PDF  « , NSuHP  1 * A N S wf  H 
GOTO  2*.« 

25  7 NP  AGF  (7,  TNOF.X,  I 1 aMPAGE  f 7,  I NOE  I.  11  4ANSWF  W 

26V  CONTINUF 

2P  4 CONTINUE 

243  CONllNtlF 

C 

C 

C 

c 

11P  CUNT  INUt 

r 

r 

c 

I C 0 M • 1 

pe  torn 
c 
c 
c 

2P|  CONTINUE 

t 
C 
C 

2«a  C o n T in, ie 

ROM*? 

PI  Tubs 

F *-■ -> 

SuBWHiiTInE  SroRF  f-P|.  atm 


1 7 2 


o o n o 


c 

r ; 

COMNON/A/TflSVS,  TSVS(RM1,NAM»  (1*1  .NPAr.F  (7,2,31, 

1 *SPK  f | 5»  01  . *KE V.LFTTFR.LIST , tSPK  , NHM|  , Nu*5  , APR  A Y f Hi* ) , 1 RESP  ( 2 , 20)  , 

DIMENSION  SFHUfK)  ,TFMPf?,gi 
IF  (NPLACF  ,N£  . 1 5 (iorn  2 

1 FORMATf  SVSTFH  TFSTETj  ' . 1 4 , 3X . 34 A? / /!SY , • NUMBER  LISTENERS 

1 SX.'NUMHFR  SPFAKfWS  »',I3//1 
6*7  FflSMATflwn 

5 HUP  CONTINUE 

on  ?a  i«i ,h 
no  22  k«i ,3 

nri  4i  j«i,2 
L ■ 6*Ta.WP**-* 

ntot  « i« 

IF  fK.NE, 1 1 NT  OT  »fl 


61 


41 

2? 

22 


n 

o 

o 

n 

o 

n 

n 

n 

o 

T 

r> 

0 

0 

n 

o 

n 

o 

n 

n 

0 21 


TOT  ■ FLnAT(NT(IT) 

l>ATAfLTST,TSPK,|  lBfP..»«Fl  OATrNPAr.Efl.J.Kn- 

NPAliE(I,.t,K1  ■ UTIIT-NPAGE  (T,  J,*1 

CONTINUE 

CONTINUE 

CONTINUE 

IF  (CIS*. AND,  11  .F-0.P1PF.TURN 
W«ITEC4,27«) 

R»ITE(4,2771 (NPAOE (1 . J, 11 , J«1 ,21 
WRITE  16,27*1  fNPAPE f 1 ,J,21 , III ,21 
WNME  (4,2701  fNPAr.Ef  1 ,.l,.11  ,1*1 ,2) 

WRITE  (6,7*<»)  MPA  RE  f?,.T,  tl  , .1*1 ,2) 

*RITF  (6,2*1)  fNPAf.t  (2,  J.21  ,.t«1  ,21 
UNITE  (6,2*21  fNPAOF  (7,. I,  31  ,.1*1  ,21 
WNI  IF  (6,2*31  (NPAfii;  (3,  J,  II  ,.1*1 ,21 
wt-TTF  (*,2*41  (NPAf.F  (3,  1.2T  , J«i  ,21 
•NTTF  (6,2*51  fuPAOF  (3,  J.31  ,.J*1 ,21 
Wl,  I TF  (4,2*61  (nPAOE  f 4,  J.  1 1 ,.I«1 ,2) 

“NT  TF  (6,2*41  (NPAC.K  (4,  J,?1  , J»1 ,21 
“PI  TF  (6,2*61  (NPacf  (4,.1,.11  , Jsl  ,21 
W*  HE  (6,24  71  (nF  AM  (6  , 1,11,1*1,21 
"p  T IF  f *,  2*41  (Nf'Anh  f 6,  1 , 21  , .1*1 , 2! 

WRITE  (6,2*61  (uPaI.F  f 6,  J , }1  ,.1*t  ,21 
• PIT  FI*, 2**)  !'•(■  « f.F  f *,  J . 1 1 , .1*  1 , ?l 
*F  I IF  (*,2*41  (t.PAf.K  (4,  J,?1  , ,!«i  ,21 
“NT  If  (6,2*6)  ( uPAUF  (6,  J..11  , Jsl  ,2) 

FORMAT  (1wt,I4,'iy,T*) 


T0T1  *1  £V»,  /Tin 
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RETURN 
CONI  1 Nllt 

nri  ? i.tST«i,mipl 
*P  I TF  (4, 670) 

W»T  TF  (6,  1 1 I06YS,  f ISY6(I)  . 1*1  .321  ,NIIM(  ,utms 
WRITE  (*, 22  11 NAME ft  1ST  1 

FORMAT  f t 3*.  J f • ♦ • 1 / • F flu  I I4TFNFWJ  »,T4,'  •'/ 
13X, 7 (»  * » 1 // 

* SP*R  SCORF'/I 
0(1  204  ISPKR«1  ,N||MS 
SO*  * 7,7 


! 7 3 


2*2 


no  9*2  i«i  .31  .*• 

J«  t ♦ 1 

SUM  ■ SUM  ♦ OATA(l  T8T,TSPA»,T)  ♦ l)ATA(l  IST.ISPKR.J) 
SUM  ■ SH«/t2..l 

w k 1 T F (A,  2031  MSP  A (I  1ST,  TSPAP)  . SUM 
2*3  rn»MA!  ik.f 7.2) 

2*  4 CONTINUE 

Mk|TF  (A,  AU3) 

MkJTF  (M,  AM) 

00  2*9  1*1  .* 

2*9  StNO(l)**.* 

00  21*  T«l,3A,2 
J « T ♦ 1 

on  211  *»1 .mums 

211  AkPAV  (A  ) »(1A  f A (l  1ST  ,A  , D 
CALI  STATSfNMMS.Jf.S) 

Sf  Nl>(1  ) *K 
SF  M)  (21 «* 

P'l  21  7 1*1  .MUMS 

212  AkPAT  (A)  «OAT  A (l.  (ST  ,A  , .1) 

CALI  STATSfMIfH.X.S) 

- SFMDM)  s V 
SFM'JfAl  * S 
0(1  213  H«1  ,MIMS 

213  AMWAVfO«(AMMAVf»1*UAfA(l  IST.A,I))/9.B 

CALL  STaTS(MimS,X.S) 

StNTCl)** 

SFM)(M«S 

CALL  OUT  f t , SF'mM) 

2lH  COMTTmiIF 

DO  PIS  A*1  .Mi’S 
SUM  s *,<■ 
no  PM  1*1  . 31  ,M 

214  SUM  ■ SUM  ♦ OAT  A m.tst ,* , n 

2 1 5 AWPAV(A)  • SUM/M.M 

CALL  STATS(NIIMS,*,«1 
SFMD(t)*» 

SFMO (?) *S 

pn  2 1 A All c MUMS 

SUM  ■ *,P 

no  217  | »2. 32. s 

217  SUM  * sum  ♦ OATAfLIST,*,  T) 

2 1 ft  APPAY(K)  s SUM/K.M 

call  stats(mums,*,si 

St  NO (3)  * * 

St  Ml)  (4)  * S 

no  ?i o * » i , mums 

SUM  » *,* 
no  2trt  1*1 ,31  ,* 

J » t ♦ i 

218  SUM  • SUM  » n AT4  (1.  TST  , A , I ) ♦ OAT  A (I  T ST  , A , .11 

219  AkPAV(A)  a SUM/1?,11 

CALL  STATS(MUMS,y,S) 

StMO(S)  « * 

StMO(S)  • s 

CALL  OiJT  (3lSSt.NO) 
mhitf  (s,  a9p) y.s 
2**  CONTINUE 

no  3**  TSPAP  * 1.NUMS 

khite(«,s*p) 

wktTt  (s,  diosts,  nsTsn)  ,i«i  ..sp)  .nhhl.nums 
m»ITE(S,3P1)MSPA(1 , 1 SPAN) 

3«l  FOPmaT (1 ?* ,••«*•* ’ / 1 FOW  SPFAAtRt  *'/ 
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! 


j 

1 12*,  '.....<//'  listener* .ax, * scorf*/)  j 

nn  3*4  list  ■ i ,numl  j 

SUM  ■ B,*  ) 

nn  3*2  l*i  .31  if> 

J*  !♦  l 1 

3*2  SliM  » SUM.OATA  (LIST,  ISPKB,  H*riATA  (LIST  . iSPKR.J)  _ j 

SUM  ■ SUM/I2.M 

WRITE (8,363) NAME (LIST  1 .SUM 

3R3  FORMAT M V , t4  ,6*  , FT. 25 
384  CONTINUE 

NRITE18.4R3) 

MRITEfS,  4V14) 

0(i  316  I « 1,35,? 

J • T ♦ 1 

no  3ii  *«i  .NiiHu 

311  ARRAY (K) .OATA (K , ISPFB, I) 

CALL  3TATS(N||ML,*,S1 

SE  no ( 1 1 »* 

SEnO (21 *S 
00  312  F,J  , ami  m L 

312  ARRAY (W) .OATA(K , TSPKR ,J1 
CALL  ST»TS(niiml,*,S1 
SFnO ( 35 ■* 

SENO (41 • * 

nn  313  k ■ i .mini 

313  asRayoo  ■ (ahnay(m1*oaTa(f,1SPk», 111/2, P 
CALL  STATS(NIIM|  ,y,S1 

St  NO (31 »Y 
SEND (Ml «S 
call  oiiKi.sFuni 
JIB  CONTINUE 

nn  313  k»i  , niiml 
Sum  • r.p 
00  314  I.l  .31 .3 

3 1 4 Sum  * SUM  ♦ OATAfF. ISPKN, II 

315  ARRAY  ( K 1 ■ SlIN/S.a 

CALL  ST  ATS  ( Nt  imi  , V , 5 1 
SENO ( 1 1 «* 

SE  NO ( 2 1 «S 
no  316  k«i  .niiml 
Sum  « fl.p 
nn  317  1 .2,32,6 

3 1 7 SUM  a SUM.OATAfK, JSPKW.II 

316  ARRAY (K1.SUM/6.P 
CAIL  STATS(MlMl  ,Y,S) 

St  NO ( 31 «X 
StNOMT.S 

no  31  9 4*1  .Nl'ML 

Sum  «P,P 

nn  3 i * (.1,31,6 

J « T ♦ 1 

31B  SUM  . SiJM*0ATA(4,  ISPKR,  JltOATAfK,  ISPFR,  J1 
319  ABB  AY  ( 4 ) .SUM/  12, f» 

CALL  STATS(NMML,X,S1 

Sf  NO (31 • X 

Sfc  NO (6 1 ■ 5 

CALL  OUT (36.SEN0T 

RBITE(6,49fl)X,S 

Tt  MP ( 1 , ISPKR1 »X 

Y*"P(2, I SPF  B 1 * 9 


3pB  CONTINUE 

“RITE (6, SBPl 

WRITE (6, 1 llnsts, (TSYS(I) . 1»1 .3P1 .niiml ,NUMJ 


nnTTE(8,32iO 

323  FtlRMAT(*  COMBIMKD  RESULTS  « STANOARO  ERRORS  ACROSS  », 
1 'SPEAKERS  ANO  I (STFNFRS  •»«•••'//) 

RR 1 1 F f «,  AP3) 
t*  W T T F (5,  43  4} 

NIIMT  * NIIMl  aMJMS 
on  321  la  1.33. 2 
J»I*1 

00  32?  K a | , niimi 
00  32?  I a 1, HUMS 
MaNlJHS*  (K-1  ) *L 

322  ARRAY(N)bOATA(*,1  ,11 
CALL  ST  AT  S (NIIMT  , X , 81 
StAOH)'* 

SkN0(21 «S 
00  323  K a 1 , NilMI. 

00  323  L«1,N||MS 
MaNUMS*  (K.n  *L 

323  AHRAYfM}al)ATA(K,l  , J1 
CALL  STATS(NIIMT,X,S1 
Sk NO (31 ■* 

SEND (41 aS 

00  324  KaJ.MlMl. 

00  324  L«1.NUMS 
MaNUMS*(K-11*L 

SUM  a nATA(K,L,T1»0ATAfK,L«Jl 

324  ARRAY  (M)  aSIIM/2.l« 

CALL  ST  ATS  (NIIMT  , X,  S) 

SEND  f 31  a* 

3k  MO (6) aS 
CALL  nuTn.SFNni 
121  CONTINUE 

no  323  Kal.NIIMi 
no  325  L«l.NliHS 
MaNUMS* (x-1 1 *L 
SUM  a 3.0 

no  32«  I ■ 1 I 3 1 #3 

325  SUM  a SUM+OATAfK.L.I) 

323  ARRAYfMI  aSIIM/fi.rt 

CALL  STATS(NUMT,X,S1 

SkNOMlaX 

SE  NO ( 2 1 rS 

on  327  Kii  ,miml 

no  327  L*1.NUM3 

MaNUMS*  (K»l ) ♦!. 

SUMB0.R 

no  325  I *2  I 32  I 5 
328  SUM  a SI/m  + 0ATA(K,L.I1 

327  ARRAY  (M)  a SUM/8,  r« 

CALL  STAT3(NtlMT,X,S) 

3EN0  (31 aX 
SEND  (4)  aS 
00  33<*  Xal.Ni/ML 
00  332  L»1.NliM3 
MaNUM3*(K-l)*L 
SUMafl , 2 

no  331  1*1,31,8 

J«T*t 

331  SUM  a SUMaOATAfK.L, tlaOATAfX ,L. J1 

338  ARRAY  (M)  aSIIM/12,2 

CALL  STATSfN/tMT.X.S) 

SEND (SI «X 
SEND (81 aS 


176 


nrm  orioori 


CALL  0UT(36,SENni 
WRITE(8, 4Q8)*,S 

WRITE (6,581!  !MS*»K  M ,J1  , J«1  .MOMS) 

WRITE  (8, 582)  fTEMI'ft  .MUMS) 

WRIIE(B,583)  !TFmP(7,k) ,K»i  .nomSI 
581  F0RMAT(//9*,0(A2,5*)) 

588  FORMAT  (/  i mean  * , <>  f 2* , F5'.2>  ) 

583  FORMAT!/*  S.F.  ' , 9 ( 2* , F 3 . 21 ) 

NPLACfc.8 

RETURN 

276-  FORMAT  T18X.  'MAIN  ATTRl « , IP*. *PPF8* ,7*. *ARS'//) 

277  FORM AT f 15*. * VOIC • . 73* , T2 . 11 X . I?) 

278  FORMAT f ?8*. 'FRIO*. 18*. IP. 11*. I?) 

279  FORMAT  (28*. * N.JN-FPTC  ' . 1 ?*,!?. 1 1 X. I?/) 

288  FORMAT  T15*. ' N AS  A|  • , 22 X , 1 2 , 1 1 * , 1 2) 

281  FORMAT  f 28*.  'GRAVE  * ,21*. I?, I !*, 12) 

282  FORMAT  f28*. ' ACUTE* ,21*. 12. 1 1 *, 17/1 

283  FORMAT!  15*. « SU8T1 N « , 78* , T2 , 1 1 * . 171 
28  4 FORMAT  T28X , » VO  I CM) » , 78* , I? , 11 X , 171 

285  FORMAT  f ?8X, 'OUVOICFO ',1H*,T2,11*,1?/1 

286  FORMAT! 15*. 'Stan  «,?«*, 17.11*. 121 

287  FORMAT!  15*.  'GRAVENESS'  .21  X.I7.1  1*,I?1 

288  FORMAT!  15*. ' COMPACTNESS »,1QX. 17. 1 1*,I2) 

488  FORMAT!'  nMT  MEANS  AMI  STANOARO  FRRllRS  FOPt.13,*  LISTENFRS'/) 

481  FORMAT  !•  SYSTEM  UNGER  TEST  I '.58A1/1 

482  FORMAT!*  MUMPER  OF  SPEAKERS  »*,T7/1 

483  FORMAT!//'  m»1m  ATTP IHIITF J ' , 1 ?* , ' PRESENT ' , 1 8* , • ABSENT • , 

1 12*. 'TOTAL*/! 

484  F0RMAT!28X,3!4*.  *rtFAM  *1/1 

498  FUBMATf/38*, '*•♦•♦•***«♦.«*•♦*'/ 

1 38*. ••  **F AM  ■ *,F«.2,»  •»/ 

1 13*. 'total  nor  scopes  **.l5*.***/ 

1 38*. '•  S.E.  • '.*  8.2.  ' •*/ 

1 38*. ••«*•••*••*«•**»•*•! 

EMO 


SOPMOOTIMF  STATS!M,*ME*M,STnFRPl 


COMMOM/A/jnSYS, I SYS (581 ,MAMf !15} , MP AGF (7,2,31 , 

*MSPK (15,91 .MPEY, LETTER, LIST, tSPK.MUML, MOMS, ARRAY (681, IRESP (2, 29), 
*0ATA(17, 6,361 
*■8.8 

*M  ■ FLOAT!N! 

no  i i ■ i . m 

* • * ♦ ARRAY!!! 

1 CONTINUE 

*ME  AN  ■ * /*  N 
STOkRR  • 8.8 
HO  2 1*1  ,N 

2 STnERR  » STnERR  ♦ ( ARR A Y (I) .*ME AN) * ( ARR A V ( I) -XMC AN) 

STOERR  » S*lHT(STnERR/XM/*N1 

RETURN 

E‘in 

- SOPM0OT I Nf  0OT(N,X) 
niMEMSION  * (6) 

IF (N.ED,36)GnT0  19 

K.fN^I!/? 
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IF  C.EO.l  0«»H 
If  fK.En,  iok*8 
IF  (K.EQ.17)K«8 
IF(K.EQ,12)»<»9 
if  ik.€o,isi*«<> 

IF(K.E1.1R)K«» 

If(K.E0.13)K»11 

tffK.E0,161K«t? 

ROTO (1 ,2.3.4. 5, 6.7. 8, 9. |P, 13. 16), « 

1 WRITF  (8,4*5)  fXfn,I»1.,«) 

RETURN 

2 wRITe(6,4AS) (Xfl) ,I»1 ,8) 

RETURN 

3 WRITF  (8,  4017)  {«m  ,1*1  ,8} 

RETURN 

4 WRITES, 488) (X(I),I«1 ,6) 

RETURN 

» write(«,4r9)  rxtn,i«t,F) 

RETURN 

«>  wRITE(6,4t*)  (X(I)  . X>  1 .6) 

RETURN 

f wRm(6,4tM  rxrn, !•!,*) 

RE  TURN 

« w«nE(8,4t?)  rxfn.m.f!) 

RETURN 

» WRITE (8,4131 (X(I) ,I«1 ,*) 

RETURN 

ir  wRiTEf«,4i4)  rxrn.iRt.8i 

RETURN 

IS  wRITE(8,415) fX(I) ,T«1  ,8) 

return 

18  WRITE  ffi, 4)81  (X(I),t»1,S) 

RETURN 

10  NRJ1F  (6,417)  fXfn,I»l,8) 

RFTURN 

4R5  EliRw*Tf3X,  »vnlCIEtr,',OX.3f3X,F6‘.2.2X,FS.2)) 

4*6  FORMAT f6X, 'FRICTIONAL' , 4 V , 3 ( 3X , F6 , 7 , 7 X . E 6 , 71 1 
4*7  F0RMAT(6X,  •Nnw-FRICTI0N*|  » . 3 f 3X  , Fft  , J>x  , FS . 7 1 / ) 

4*H  format f3x, * nasal  I tv » , ax, 3 (sx. F6,?,?x, F8,?l 1 

4(MJ  FORMAT (6X,  'GRAVE'.RX.SOX.FS’^^X.FB.?)) 

41  M fORMAT  f6Xp  • AC"TE • ,RX,3(3X,F6'.  ?,7X,F6.?)/) 

41  I FORMAT  f3X,  'SUSTENTION'  . «X , 3 (3X . F8.7, ?X . FB ,7) ) 

412  FORMAT (BX,  'VOlCEP',8X,3(3X,F8,?,7X,F6f7)) 

413  FORMAT  (6X, 'UMV01CEO«,8X,3{3X,F6,?,7X,FB.7)/1 

414  FORMAT  f3X, 'SITUATION'  ,6X,3(3X.F8,7,7X,E6,?)) 

415  FORMAT (3X, 'GRAVEN* SS' ,7X, 3 T3X.F 6.7, ?X,F6.?1) 

416  FORMAT  TUX , 'COMPACTNESS • ,5X,3(3X,F8.7,?X#F6.?) ) 

417  FORMAT f3X, ' TOTALS' , IPX, 3f3V,F6.?,2X, F6. 211 
ENP 

SOBRPUT I NE  MATR 

COMMON/A/JPSVS,  ISVSC5P1  ,E'*mf  H51  ,NPAPE  f 7, 2,31  , 

7MSP" (19,0) ,MKEV,t ETTER.LIST, ISPK ,numl,NuMS, 4HR4T (601 , IRE SP f 7 , 70) , 
XOATA (12,8,38) 

0 1 MENS I ON  XMATR(13,8) ,ITALR{0) ,4NS(7,61 

01 WENS  ION  0EV(1»,81 , V*R(131 ,XLM(15) ,SM(6) ,FSTAT(!S) 

01MENSI0N  NNFK8) 

DATA  IBLNK/2H  / 

C 

KKK«4 

Nl)Nf»8 

C 

on  2PP  Irj.niiml 
on  2«p  K«1,NUMS 


178 


202 


2nd 

C 

312 


2«3 

204 

C 


mm 

mn2 

c 

c 


209 

2m 

2*7 

2ns 


2nn 

2n«?  " 

3no 

1003 

moi 


SUM»n, 

no  202  I T ■ 1 1 5 1 < s 

J J ■ 1 1 ♦ 1 

SUH«5UM»r)AT4(I,K,II)*0ATA(T,K,  JJ) 

SUH»SUH/1 2. 

CONTINUE 

00  !JH?  JJJ»1,K*K 
DO  203  I ■ 1 t 9 
ITALK(T)»tBLNK 
00  J04  I ■ 1 , NUMS 
iT4i«tn»HSPKfi,n 

writer, mm 

WHITE (8,  1071  I OS  VS,  (ISVS(T)  ,I«t  .30)  .NIIMI  ,NUMS 
WRITEIS, 1 03) 

WHITE  (8,  mrn 

if  fNijHs.Ffj.mwMTEfs.mwn 

IF  fNUNS.EO, 31  WHITE f«, 10021 
FORMA T(tH*t4nX,4HMF  AN , 4*  . 4HS'  E . ) 

FORMAT ( tH*,?H»,4HHF  AN.4X.4NS. El) 

WHITE (8,1 021 


00  201  L TST« l , Niihl. 

DO  209  ISPK»1 ,NUHS 

ARRAY (I SPK) «XHATP (LIST, I SPK) 

CALL  STATS(Nl|MS,X,$) 

WHITE  (8,  1011  NAME  (LIST  1.  (XMATP  (1.  1ST  , I SPK)  , ISPK»1  .FUlMS)  , X.S 


00  208  I3PF  ■ 1 ,NI|MS 

DO  207  L T ST  « 1 , NilML 

AHR4YCLT9T1 ■XHATB (LIST. I SPK) 

CALL  STATSfNllML.y  ,S) 

ANS(t,TSPK)«X 

ANS (2 * T SPK  ) »S 

CONTINUE 

WHITE  (8,  104)  (ANSM,n,I*1,N|IM51 

WHITE (8, 1091  TANS (2, I) , T»1 .NUNS) 

00  208  I SPK ■ 1 , MUMS 

00  200  LTSTW1 ,N0ML 

K«NUHS*(LIST-1)MSPK 

ARRAY (K) •XM4TH(LIST, I SPK) 

NUMT«NUN3«NIIML 

CALI  STaTS(NI|WT,X,S1 

WHTTEfR.IOSlX.S 

CONTINUE 

VHIftwo. 


WHITF(S.IOO) 

WRITE  (8, 1071  I09YS,  TISrS(T),I»1  ,3m,NUHI.  ,N(|MS 
WH I TE (8 , 300) 

FORMAT  (//2X,  'LISTENER  DEVIATIONS  FROM  SPEAKER  MEANS'//) 
WRI TF (8, 1 03) 

WRITE  (8,  m«)  (ITALK(n,I«1  ,9) 

IF (NUMS,F0.8)WHITEf8, 10035 
IF  (NIIHS.EO.  31  NR  JTE  (8, 1004) 

F0RMAT(1H*,91X,3MVAR) 

F0RMAT(1M4,30X,3MVAR) 


WRI TE (8, 1 02) 
xnums»nums 


XNUMLnN'JHl 
TUTAL«»NtlMS*XNUML 
DO  301  J»  1 .MIMS 
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nn  as»2  i>i  ,mimi 
3*2 

3*1  SMf  JT  ■ SlJM/XMIH| 

no  3*3  I • i . siimi 
Sons*  , 

no  3*4  j*i ,nmms 

3*4  3llM*S(.|N*XMAt»  (I  , J1 

3*3  KI.M(TT  ■ SlfT/XMlHS 

Suiic, 
no  ,**> 

3*5  Sl'McSt'"»VL*(  TT 

GM«S'lM/*Mi“L 

r 

no  3*5  1 » J , WIIMt 

no  3«7  j»i,nii.*s 

3*7  nt- v n ,.n  «x**r<  n ,.n-s«  r ji 

SS«*. 

00  3*H  J«1  ,NIIMS 

3*o  ss*ss*n(-v(i,.n*nf  vn  ,.n 

VAP  ( I ) •SS/XM'ins 

IF  ( V*«  m .1  E . vpjnr.'i  TO  33* 

V8TG«VARf II 

mioii 

33*  wkj jii.  vf i,j> ,.i»i .oiihsi ,v*»f n 

c 

CALL  llllTt  «(XMATw,MU'H  , NijMS,  I.F.FSTATT 

c 

3*6  COMtlNHr. 

C 

Kf<P»NljML-«JII«S»1 

wNME(6,4*rMNiihS,*<«P 

4**  format r//<  r statistic  fob  testing  mcm  l t stfnfh 

X AS  AN  OllT-LVFN'//'  COMPARE  WITH  F PERCENTAGE  POINT 
X 4 I T H 0F*»,T3,  • ANO«,I?/T 
WRITF(«,4*1) 

4*1  FORMAT!*  LIST.  F'/l 

00  4*2  I«1  , NilNL 

WPITF(«,4*31NAHF  (11  .FSTATm 

4*3  FORMAT (IS, F*. 3) 

4*2  CONTINUE 

IF  fNU*L.Le.«5ST()P 

NUHE»NlliF4l 

NMFL  {NUNF1  »NANE  (LBK.5 

RRT1E  («, 6**1  TNNEI  (II  .1*1  ,N|l*F! 

3**  FORMAT (/I X. 'NILL  ELIHl * ,4161 

IF  (IRIti.FQ.MIMLK.n  TO  31* 
on  31 1 !»L«ir,,NijML 
IP1 «I*1 

N4ME(n«MAME(lPl) 

00  31  1 J«1,MI«S 
311  XMAIWtl, JJ»XMATH(TP|,JT 

3i  * numl«niiml.i 

KKKsI 
GO  in  312 
ccccccccccr. 
ccccccccccc 
cccccccr 

1*0  F0RMAT(3»,0(3X,A2,?xn 

1*1  FORMAT (/IX, 14, IX, 11  (PX.F3.2T/T 

1*2  FORMAT!*  LIST.'I 

103  FORMAT (0X, *5PEAKFRS*/1 

1*4  FOPMAT(/*  MEAN*, IX, 11 (?X,F3,2T/T 
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I 


laS  FORMAT!/'  J.F.MI.IIOI.FJ,})/) 

las  fo»mat(/?px, 

xsnx,**  hf an  ■ **/ 

X13X, » TOTAL  ORT  SCORE!  a'.lSX,**'/ 

X3*x,  i«  S.E.  ■ ' ,F«.?, * *•/ 

X3aX, |7f  •*•)) 

1 a7  formatc  SYSTEM  ',I4,3X,SnA?// 

XSX, 'NUMBER  LISTENERS  ■ * , 13/ 

YSX, 'NUMBER  SPFAKFRS  a', 13//) 
las  F ORM  AT  ( 1 M 1 , * ») 

C 

c 

Eon 

SUBROUT  tNE  STATS  (N,  XME  AN,  »T|tF»S) 

COMMON/ A/ tflSYS,  t SYS (SHI  ,NAMf  MS)  ,NPAGF(7,?,3)  , 

YMSPK  flS,0) , MKEY, LETTER, LIST, ISPK ,NIIM|  , NUMS , ARRAY (SB) , TRESP f ?. ?9) , 
XOATA  M7,*,S«) 


1 


2 


C 

c 


c 


laa 


Tan. 

XNaELOAT (N) 

DO  1 lal.N 
X aX  + ARRA V ( I ) 

CONTINUE 

XME  AN  ax  / yn 

STOfeRRaa. 
on  ? I a 1 , N 

STntRRaSTOERW*  (ARRAY  fD-XNEAN)  a (ARRAY  (I) -XME  AN) 
STOERRaSORT(ST0ER»/XN/*N) 

RETURN 

ENO 


SUBROUTINE  OUTl.  R(OATA,N,IP,  I OUT  , F , FST  AT  ) 

OIMENSION  $(b,S) , DATA (15.61 ,XMFAN(B) , TFMP (6) , SI N V (» , «) 
niMENSTON  FSTAT(lS) 


P«IP 

KaN-1 

XKaK 

KHPaK*  (K-IP) 

XSfJaJP*  f <*Y.n 

YFMPaKMP 

XSSOaKSQ 

R AT  I Oa  YK  HP  / XF  SO 

00  in*  Ial  , IP 

XMFANdlaO, 


»HIS  PAGE  IS  BEST  QUALITY  PRACTICABM 
raOM  COPY  FURNISHED  TO  DDC  * 


on  i a i jat.IP 
on  int  I a i , n 
IFfl.EO.lOUTlGO  T(1  1P1 
YMF  AN  (.1)  BY  MFANf  J)*OATA(I,  JY 
ial  CONTINUE 

on  in?  Jbi.ip 

la?  XMFAN(J)aXMC*N(J)/XK 

r. 

XX  MaKot 

c 

OU  |B3  I a 1 , t P 
TE  MP (I ) an, 

00  1P3  Jal.IP 

ta3  S(l,j)aa. 

1 la? 

00  1 P 4 Ial.N 
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E> 

l 


uuuuu 


lEfl.EQ.IOUTjGO  m 1 (44 
DO  IPS  J« t , IP 

1*5  TEHP(J1 aOATA f I, JT-XHEANIJ) 

00  1*8  J»1,IP 
DO  1*8  JJ*I,IP 

1*8  S(J, ♦TEMPI Jl*TEMPf.M) 

1*4  CONTINUE 

00  1*7  la  1 f IP 
00  1*7  Jat.IP 
1*7  S(I,J)bSII.J1/**<M 

C 

CALL  INVFBS(S,SINV,IP) 

C 

00  111  Jai.IP 

111  TEMP (J)aO*T* (TOUT, J1-*ME*NfJ> 

C 

C 

Da*, 

00  H?  Ial.lP 
00  112  Ja!,lP 

112  naDaTEMP(I5*8I*,V(I,JlaTEMP(Jl 
KMPaKaJP 

ESTATflOuTlaRATIOaP 

RETURN 

ENO 


SUBROUTINE  INVERSE 


SUBROUTINE  INVERS(A,B,N) 
DIMENSION  A ( A » 6 ) , B f 9 , A 1 
EPS*  « **44  1 
no  6 Ial.N 
DO  5 Jal.N 
IEfI.JJi.3,4 

3 Bfl.JIal.* 

GOTO  5 

4 R(!,J)a*> 

5 CONTINUE 

6 CONTINUE 
DEL"!.* 

DO  49  K a l f N 
IEfK»Nl l?,3*,3* 

1?  I M A X BK 

AMAXaABSf AfK,K)l 
KPi aKai 
00  2*  IaKPl.N 
OTEEaAMAX»ABS(A(I,X}l 
TE(0IPP)19,?*,?* 

13  I M A X ■ I 

AMAXaASSf  Afl.Kn 
2*  CONTINUE 

IFfIMAX-X)?3,3*,?3 
23  00  29  Jal.N 

ATMpaAfTMAX,.!) 

*nMAXtJTBA(X,J) 

A (X . J ) a A TMP 
BTMPaHf IMAX, J) 
B(IMAX,JTaB(X, J) 

29  B (X , J) aHTMP 

DEI.  a»0FL 
3*  CONTINUE 
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OIFF^ASSf  AfA.K  WPS) 
IFfDIFF)03,<93»35 
35  DFL ■ A f K , K ) *nFl 

mv»A(K,K1 
DO  35  J«1  ,N 
A (K,J)«A(K,J)/Plv 
35  RfK,Jla5rK,JWnTV 

no  43  i*i,n 

AOUL  T ■ A ( f , K ) 

IF  f 1.5)30,43.39 

30  on  49  j»i  ,n 

All,  J)»Af|,  J)-AHIU.T*AfK,.l) 

49  en,J)»H(I,J)-A*UiLT*R(K,J) 

43  CONTINUE 

43  CONT  IN|/« 

90  RETURN 

93  WRTTF(5,i13) 

I 1 3 FORMAT ( / • * SINGULAR  MATHIT  • •/) 

EnO  o 


183 


STSTE*  TFSTffM  11i*4 

18-11EC-77  PWOBF 

1 

MJM8FB  LISTENERS 

N ( t M H E P SPtAKFWS 

■ 1 1 

• 3 

FOP  LlSTFNFWJ  1277  * 

SPKP  SCOPE 

• 

nv  fo,fin 
.It.  B9.S0 

PO  05,75 

THIS  PAGE  IS  BEST  QUALITY 

from  an v FURN i '•;! f: ■ , •.  > 

ITiACTICASiiS 

MAIN  ATTPIPUTEl 

PRESENT 

ABSENT 

TOTAL 

MEAN  S '.  E '. 

MEAN 

8.F. 

MEAN 

S.E. 

voicing 

rBICTIO*J*L 

NON-FPICTTONAl 

IB". BP  o'.oo 

IMP,  BO  0.00 
IPO, BP  B.PP 

87.50 
03'.  33 
01.87 

3.89 

8.80 

0.80 

93.73 

91.87 

93.83 

2.93 

3.40 

3.40 

NASALITV 

r.PAVt 

ACUTE 

9N.P3  3*.  40 

ifflo.pn  b.bo 

PI .87  8 , 8B 

100,00 

100.00 

100.00 

0.00 

o'.oo 

o’.oo 

07.9? 

100,00 

93.83 

r.70 

0.00 

3.40 

SUSTENTION 

VOICFO 

uMvnirtn 

03.33  8‘.P0 

73. OH  11.70 

01. 87  B.8P 

50.33 

50.00 

08.87 

3.40 
00'.  41 
13.81 

70.83 

82.30 

79.17 

4.30 

11.79 

3.40 

SIBILATION 

voiCFn 

IIMVOICEO 

95.83  3.4l» 

1 PP.00  0,00 

91.87  8,00 

100,00 

100.00 

lOO'.OO 

0,00 
0.00 
o'.  00 

07.92 

100,00 

95.83 

1.70 

0.00 

3.40 

GRAVEN ESS 

VOICfcO 

UNvairtn 

01.57  3.4P 

1-40.00  0,00 

83.33  8,0" 

79,17 

100.00 

38.33 

9.00 
o'.  00 

18.00 

83.42 

100.00 

70.83 

S'.  40 

O.00 

8.80 

COMPACTNESS 

VOICF.O 

unvoiceo 

100.0"  o'.oo 

100,00  O.PO 
10". 00  0,00 

100,00 

100,00 

toti.oo 

0,00 

o'.oo 

o'.oo 

100.00 

100,00 

100,00 

o'.oo 

0,00 

0,00 

TOTALS 

04.44  2.77 

87.30 

0,00 

90.97 

1.13 

i 

TOTAL  OPT 

• MEAN  ■ 

SCOPE  1 • 

♦ S.E’.  . 

90,97  * 
* 

1.13  * 
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i 

' 

SYSTEM  TESTED!  li«4 


16-OEC-77  PROOF  1 


NUMBER  L I ST£N£RS  • t) 
NUMRER  SPEAKERS  a 5 


pUR  LISTENER!  334?  • 


SPKR  score 

PV  PB.54 
Jfc  P?,?9 

»D  93, 7S  '• 


MAIN  ATTRIBUTE!  PRESENT  ABSENT 


MEAN 

s.e'. 

MEAN 

S.E. 

MEAN 

S.E. 

VOICING 

FRICTIONAL 

NON-EPICTIONAL 

95. «3 

IrtB.MB 

91  .67 

3.40 

B.BB 

B.BB 

91  ,P7 
IBB-.  BB 
"3‘.33  . 

6 , BB 
B.BB 
13.01 

93.73 

1 BB.OO 
B7.5B 

5.1fl 

0.00 

10,91 

NASALITY 

ORAVE 

acute 

IPO. 'IE! 
109. BP 
Ihb.bb 

B‘.00 

O.PP 

B.00 

95, B3 
91,67 
1BB.BB 

3,40 

6 .SO 
B'.BB 

97.9? 

95. S3 
1BB.BB 

1.70 

3.40 

0.00 

SUSTENTION 

VOICED 

UNVOICED 

5".  33 

5B.PP 

**.67 

t9.?7 

11.79 

16,00 

73. BB 

75  . BB 
7S“.B0 

3.B9 

11.70 

11.79 

BS.S7 
69. »B 
7B.S3 

6.51 

10.91 

6.00 

SIBILATION 

VOICED 

UNVOICED 

79.17 

79.B0 

5S.33 

9. MB 
11,79 
13, PI 

100.00 

1 BB  , BB 
lBB’.BB 

B.BB 

B.BB 

B'.BB 

S9.58 

57,50 

91.67 

4.90 

9.69 

6.60 

GBAVENESS 

VOICED 

UNVOICED 

91.67 

10B.BB 

M3. 33 

3.4P 

0.00 

P,SP 

7B , S3 
IBB. BP 
41. 67 

3 . 4 B 
B.BB 

6 . BB 

St. 96 
10B.B0 
69.50 

2.99 

0,00 

9.09 

COMPACTNESS 

VOICED 

UNVOICED 

1BP.PB 

IHB.PP 

10B.BB 

B'.BB 

0.00 

B.0P 

1 00 ,0P 

IB" .00 

1 BB  . BB 

B.BB 

B.BB 

B.BB 

1"B.00 
100,00 
IBB, BO 

o.oo 

0,00 

0,00 

TOTALS 

B7.5B 

3.93 

SB, 69 

1 .SB 

* S . t 9 

2.70 

total  owt 

♦ l 

• 

SCORE  1 * 

MEAN  ■ 

8R.19  * 

♦ 

• 

S.E’.  b 

9. 79  B 
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SYSTEM  TESTEDl  113  4 15-0EC-77  E9IW  1 

MliMHEfc  LISTENERS  • 1) 

Nl'MHfcW  SPEA5EPS  » 3 


Fl'»  LIS T F»- 1 W t 4*35  • 


SPKH  SfOME 

8V  63.54 
JE  00.31 
90  93.71 


THIS  PAGE  IS  BEST  QUALITY  PRACTlCAlM 
JKQM  COPY  FURNISHED  TO  DDC  „ - 


MAIN  ATTRIOUTfcf  PPE'SfNT  AHSEMT  TOTAL 


MEAN 

S.E. 

mean 

S.F. 

MEAN 

S.E. 

VOICING 

. 1P0.PP 

0.80 

91 ,57 

6.38 

05.83 

3.48 

E9ICTI0OAI. 

1 0P.P0 

P.83 

0 1.67 

6.80 

95.83 

3.40 

‘■ON. KBIT  TIilNAL 

1 Op  , PM 

O.PP 

91.57 

6.80 

95.83 

3.40 

NASALITY 

1 03.00 

O.PP 

1 80,08 

8 ,P8 

100.08 

8.00 

GRAVE 

1 <*P.Pl< 

O.PO 

180.88 

8.80 

1 80.88 

8.88 

acute 

1 <*P  ,00 

«.PP 

100.08 

8.88 

180.00 

8.88 

SUSTENTION 

SB.  ,13 

9.  OP 

63.53 

5.00 

58.43 

r.4i 

voicen 

50,01(1 

Sr.il 

41.67 

18.80 

45.83 

14,35 

I'NVOICEn 

50.57 

13.51 

• 3.33 

13.61 

75.08 

8.88 

SIBILATION 

55.57 

13. 37 

1 50.  PC* 

0,88 

33.33 

5.13 

voiced 

53.33 

5 , Of* 

1 80 '.88 

8.88 

91.67 

3.48 

UNvoirtr 

IP.PP 

3P.  41 

100.80 

P.88 

75.88 

18.21 

GRAVEnESS 

01.57 

6.30 

70.17 

3.48 

"5.42 

J .78 

voiced 

1 1*0. Pi" 

P.PP 

188.88 

8.88 

188.08 

8.80 

1 NVOICEO 

33.33 

13. *1 

5H.33 

6.88 

78.33 

3.40 

COMPACTNESS 

"5.83 

3.4P 

1 80,80 

8.88 

07.92 

1.78 

VOICED 

1HP.PP 

P.PP 

100.80 

8.80 

108.88 

0.80 

I'NVQ  J CEO 

91  .57 

6.38 

ipo'.oo 

8.88 

95.33 

3.48 

TOTALS 

PS.  A? 

4.5P 

33 , 80 

1.58 

37.15 

3.88 

• MEAN  ■ 87,55  * 

TOT*(.  OPT  SCORE*:  • • 

* S.E.  ■ 3,01*  * 
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£jaS3WJKKaBM:  mat 


SYST^k  TFSTf-nj  11^4  1S-DEC-77  PPOBF  1 

N I.* M H F k LISTES.FP5  s n 
Mt'MHFK  SPFAKFPS  ■ * 


FOp  LISTFNFPI  4:145  , 


spkp  srnwf 

*V  F7.«U 
JF.  F4 ,37 
9U  04.70 


MAIN  ATTPlmm.  J 

PPF.  SFmT 

ARSFNT 

TOTAL 

MF  AM 

*'X. 

«f  AN 

S.F. 

mean 

3. El 

VOICING 

FPICTTONAL 

NnN-FoicrroNAi. 

1"««.77 
i • n , p * 

1 *1W  . f<*/ 

<«.  "7 
*.pp 
7.7k» 

91.57 

91  .67 
01.67 

8.87 

5. 87 
*.87 

95.83 

95.83 

93.83 

3.47 

3.40 

3.47 

NASAL  IT  V 
rs  AVL 

ATl'Tt 

tc*".f»7 
ltin.  77 
t^P.P.* 

7.  "7 
7.77 
7. op 

177,77 

177.77 

177.77 

7.77 

*.77 

p'.np 

1 77.77 
177,78 

1 "7.7« 

7.77 

7.78 

7,77 

SUSTFMinN 

VOTCFn 

I'Nvnir  i n 

7*1.  up 
sp.87 
83.33 

5. no 
13. *1 

8,87 

SB.  57 
38.33 
75.77 

9.78 

18.77 

1 1.79 

7".83 

87.57 

To.ir 

8.87 

13.59 

3.47 

SI"  II.  A T JON 

vnrctf' 

i-woirtn 

P7.1P 

8.3.33 

Pt  .*7 

7.77 

8.87 

*.87 

177.77 

177,77 

177,77 

7.77 

7.77 

7.77 

93. T3 
91.87 
93.83 

7.77 

3.47 

3.47 

OPA  VFNE.NS 
vnictn 

I'Mvoircr 

1 '»p.pp 
33.33 

9.  '47 
i . n r» 
18.7P 

70,17 
tnpT.PP 
MS. 33 

3.47 

7.77 

8.87 

72.07 

177,77 

43.83 

6.13 

7,77 

17.27 

compactness 

vnicm 

I'vvnirsn 

1 ,7V 

1 'in.po 

y.?v 

p.pp 

p.«p 

lPP.no 

1 7 7.77 
lPrf.np 

7,77 

7.77 

7.77 

177.77 

177,77 

1 "",77 

7.77 

7,78 

7.77 

totals 

""jo 

7.47 

50,54 

?.S7 

*8.89 

2.32 

Tiitai  n»T  ScnvF: 


* IF AM  ■ 8H.BQ  . 

♦ • 

* S.E.  ■ ?,57  * 
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SYSTEM  TESTED!  tl  014  16-0FC-77  PBDBF  1 


Nl.'MHEB  LISTEnEB*  • 11 
*ni“*E#  SPEAKEBS  » 3 


FOB  LISTEMFBt  5406  • 


SPkB  SCOBF 


8 V PS. AS 

JE  86.54 

BO  pa. 6? 

+ f i _ ...  A - 

0,01'J  i 

!y  *v«  1 - * - 

MAIN  ATTRIBUTE! 

PBESFNT 

ABSENT 

TOTAL 

►if  AN 

s.r. 

MEAN 

S.E. 

MEAN 

S.E. 

voicing 

ind.oD 

a",  on 

83.33 

p.an 

01  .87 

4.5* 

FBICTIONAL 

lAd.oa 

0.00 

83.33 

5.80 

01.87 

3.40 

NDN-FBlf TIONAL 

tnc.na 

a. PC 

83.33 

13.81 

91  .67 

6.80 

NASALITY 

1PA.AF 

n’.no 

1 an, no 

n.na 

1 an, pin 

0.00 

GRAVE 

inP.PP 

o.nn 

inn. on 

a. an 

1 nn.nn 

0.00 

ACUTE 

1 1C.PF 

a,  an 

ina.nn 

n.an 

1 an. an 

0.00 

SUSTENTION 

79.17 

O',  an 

5*.33 

8. an 

88.75 

2.95 

VOICED 

8*. 87 

13,61 

sa.nn 

n.an 

58.33 

8.60 

UNVOICED 

01  .*7 

F.sn 

88.87 

13.81 

70.17 

3.40 

SIBTLATTDn 

05.83 

3.40 

Ipn.pa 

n.an 

07.92 

! .70 

VDJCtD 

J c»0 .00 

a, an 

tan. on 

p.an 

ina.nn 

o.no 

UNVOICED 

01  .87 

a. an 

inn. an 

n.nn 

95.83 

3.40 

GBAVENFSS 

68.67 

3.4a 

70.17 

O.an 

72.92 

fl.IS 

VOICED 

OJ  .67 

a.ap 

inn. an 

a. pin 

95.83 

3.40 

UNVOICE n 

41,87 

8. an 

58.33 

1 R.nn 

sn.nn 

11.79 

COMPACTNESS 

IOC, MO 

a. a a 

1 an, an 

n.an 

ina.nn 

0.00 

VOICED 

a.ap 

inn. an 

n.nn 

ina.nn 

0,00 

UNVOICED 

1 c<0 .01* 

a, an 

ina'.aa 

n.an 

inn.nn 

0.00 

TOTALS 

oo.?s 

1 .5a 

88.81 

1.50 

88.54 

0.96 

TOTAL  DOT  SCDOFI 


• MF  AM  ■ 86,54  • 

• * 

• S.E.  ■ 0,96  * 
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SV$Te«  TE$T£P | tti»4  I8-0FC-77  PRPPF  \ 
HU*»F.W  LISTfMeRS  ■ 11 

NUHPFO  speakers  ■ * 


FOS  L I STE>'E  R { 8{w»4  * 


SPk«  SCORF 

"v  po.su 
jfc  P 7 . 3 
»0  03. 03 


MIS  PAGE  IS  BEST  QUALITY  PRACTICABLE 
ISQU  COPY  FURNISHED  TO  LDQ  .» — 


MATN  ATTRlBUTFl 


PRESENT  ABSENT 


TOTAL 


me  AN 

S.K. 

MEAN 

S.F. 

MEAN 

s.e. 

VOICTNG 

PRICTIOmal 

K OF'«FP  1 f T T (.(►«  Al. 

1 P'*.:iP 
IBP.  (10 

1 "c.ni> 

0 . f»B 
p.BP 
B.Bf* 

08.83 
01.87 
ISO. BP 

3.40 

8.8P 

P'.PP 

07.9? 

05.83 

1 BP. BP 

1.70 

3.4B 

P.PP 

SASALTTV 

GRAVE 

ACUTE 

1 p 

1 . *r«  n i • 

1 • • 

< <1  ,r.-i» 

•».P» 

P.PP 

o.-*P 

OS, PS 
01.87 

1 n 0 . r»  n 

3.4P 

6.00 

p.pp 

07.9? 

95.83 

1 Bp. BP 

1.7P 
3. 40 
0.00 

SUSTFmTIOn 

VOTCPO 

UNVPTCE.O 

70.17 
SR. 33 

1 !'!•  .5*1* 

O.lio 

1 *.»* 
0,(*  l* 

7».83 

73.  nn 

88.87 

3.4P 

M.70 

13.81 

75. BB 
S8.87 
83.33 

5.80 

13.01 

0.80 

SI8TI  ATjn*' 
vorctr. 

UNVOICED 

87  , *>t» 

0 1 . A 7 
83.33 

•>.80 

8 . B« 

17,81 

1 PP.BP 
IBB'.  »p 
IBB. BP 

P.PP 

3.00 

0.00 

03.78 

03.  "3 
01.87 

2.95 

3.40 

8.80 

GWAVF>,E'S« 

VOlCtU 

1 1 M v 0 I r fc  n 

°1 .07 
01.87 

Oi  .87 

*.*P 

*.Ai» 

*.*P 

7 P , 8 3 

1 PB.OB 

8 1.87 

3.4P 
P.00 
S'.  Pr* 

■1  .!>5 
05.83 
88.87 

2.95 

3.40 

3.4P 

COMPACTF'Ff  3 

vnir^n 

t'Mvnirtn 

1 1" « , o r 

l-if.PP 

1'ifi.BP 

P.Bp 

P.PP 

B.»P 

1 PB .BP 
Ipp’.BB 

1 BH.PB 

P.PP 

P.PP 

P.PP 

100.00 

1PP.BB 

IBB,*/ 

P.00 

P.00 

P.00 

totals 

o :i . ri  a 

3.P» 

88,80 

1.13 

OP. 07 

2.04 

TOTAL  fRT  SCURF; 


• "FAN  ■ 00,07  • 

♦ • 

* S'.E.  ■ ?,P4  « 
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stsrFf  itsrens  iim  i6-ofc-77  pBf^F  i 


Sl.u^FK  LtSTgKgOS  • U 

SPk»KPP»  ■ 3 


FOP  UI5T^4F«: 

spk*  sr.n«F 


* V 

Jt  *0.71 
PI)  99.71 


IBIS  PASS  IS  BEST  QUALITY  PRACTI£A£Zs3 
JR*  OOPYilPUSHap  10  BBC  -■ ' 


HiJN  ATTWJ«l>TE* 


IBIS  PAGE  IS  BEST  QUALITY  I 

JR*  COPY  IJJRHISHap  IOLDC 

P9Fse*'T 


IF.  AN 

S.E. 

v ( j t r P'G 

01  .17 

6.*0 

6.00 

FOTCUOMl- 

01 '.*7 

6.90 

.r,M-FOK.n0NAL 

J 99  <*4  9 <•  f? 

1 «•.((»  .f1* 

1 ;»p  .00 

P . V 9 

NASA11T7 

C.P0 

GRAVf 

AC  JTt 

!»,00 

7 6.'»P 

is.  *0 

SUSTFNl ION 

7S  .09 

11.70 

vniCrn 

AN  P0 

20.41 

i.mvhi  r i 'i 

C 1 .67 

3.49 

SIRU  »T  jn>1 

01  .67 

6.9P 

V01C»9 

6.00 

ii*)V0If  60 

GHAVF*'FSS 

7 N . HP 

5.90 

1 ci  n , P p 

0.00 

VOICES 

SC  .Pi-’ 

11.79 

i nvOICF'S 

pjkf  »ct»fs* 

i «o .rP 

P."" 

(*  .00 

1 

!»,00 

...  vt'trto 

1<0  ."0 

6.  P4 

totals 

• mfan 

totai 

nuT  SlU’O*  : 

• 

* S.E’. 

MEAN  3.0. 


*3.33 
**.67 
103 .«P 

199,00 
100,00 
l 00'. 

■Id  , * 7 
33.33 

75.00 

10»,"0 

IBIH’.flP 

10«'.00 

79,17 

1 0P .00 

53.33 

91.  *3 

100.00 

oi  .17 

*5.47 


TOTAL 

mean  »•*• 


«,*0 

13.91 

9.99 

9.9(1 
9.99 
9*.  99 

14.93 
94. S3 

11'.  79 

9.99 

3.99 

9*.  99 

3.99 

W .9(1 

13.91 


• 7.39 
71.17 

03.93 

199.99 

199,99 

199.99 

34.99 
S 4 . 1 7 
73.99 

05.93 

93.93 

09.93 

77.9* 

1 •«.90 
04.17 


0.99 

3.49 

3.40 

0.00 

0,00 

9,00 

14.03 

10,99 

11.79 

1.79 
3.49 
3.40 

1.79 

0.90 

3.49 


3.40 

d'.d* 

0.99 


97.97  l*™ 

100.99 

93.93  3,40 

*7.13  3.99 


SYSTEM  TESTED!  1104 


16-DEC-77  PROOF  1 

NUMBER  LISTENERS  «■  11 
NUM8ER  SPEAKERS  ■ 3 


FOB  LISTENER!  8066.  * 

*******  » 


SPKB  SCORE 

flV  91.67 

JE  98,62 

BO  91.67 

MATN  ATTRIBUTE! 

PRESENT 

ABSENT 

TOTAl 

* 

MEAN 

S.F. 

MEAN 

S.F. 

MF  AKl 

S.E. 

VOICING 

1 O«.0O 

o',  oo 

96.63 

3,40 

07.9? 

1.70 

FRICTIONAL 

IMP  ,P0 

0.00 

100.00 

o'.oo 

loo.oo 

0.00 

vON-FRICTTONAL. 

1 1 

0,00 

91'.  67 

6.80 

95.63 

3.40 

NASALITY 

100.00 

0.00 

06.63 

3.40 

97.9? 

1 .70 

C-BAVE 

1>*8.P0 

0,00 

91.67 

6.80 

93.63 

3.40 

acute'1 

10P.P0 

0,00 

100.00 

0.00 

1 00. OR 

0.00 

SUSTENTION 

91.67 

3. AO 

76.00 

0.00 

• 3.33 

1.70 

VOICED 

63.33 

6,60 

63.33 

13.61 

63.33 

9.00 

• (INVOICED 

100.00 

0.00 

66’.67 

13.61 

83.33 

6,80 

SIBILATION 

79.17 

3.40 

96.63 

3.40 

87.50 

2.93 

VOICED 

63.33 

6,60 

loo'.oo 

0.00 

91.67 

3.40 

unOoiceo 

76.06 

11.79 

9 1 67 

6.80 

83.33 

6.80 

RRAVENESS 

87.50 

6.60 

76,00 

IP. 21 

61.23 

2.93 

VOICED 

nc.pn 

0.00 

100.00 

o'.  00 

100.00 

0 ,00 

UNVOICED 

76. OP 

11,79 

60 ’.00 

20  .41 

62.30 

3.89 

COMPACTNESS 

100.00 

o’.oo 

100,00 

0,00 

100,00 

0.00 

VOICtO 

1 00.00 

o.oo 

100.60 

o'.  00 

100.00 

0,20 

UNVOICED 

1«0.00 

0.00 

too'.  00 

0.00 

loo.oo 

0,00 

TOTALS 

93.06 

1.60 

09,66 

0,96 

91.32 

0.28 

« 

TOTAL  DRT  SCORE I * 


HF  AN  ■ 

3 E » 


91.32  * 

* 

0,?#  * 


amts?. 


SYSTEM  TFSTEOS  11B4 


15-0FC-77  PROBF  1 


r 


NI'MPFR  LISTENERS  « tt 
NUMBER  SPF.AKFNS  * 5 


FOP  LlSTF‘’FRt  9330  « 


SP<«  SCORE 


OV  54.37 
JE  P7.5P 
RU  07. 0? 


MAIN  ATTRIBUTE  ! ppf.sfmt 

ME'  AN  S.F‘. 

VOICING  . IP'I.P"  P'.8P 

FRICTIONAL  Iwp.pp  5.PP 

non-frictional  K'P.PP  P.»P 


NASALITY 

GRAVE 

ACUTF 


95.53  3'.  4P 

91.57  5.50 

IrtP.PP  n.i*P 


SUSTENTION 

VOICFD 

UNVOICEO 


73.CP  11.70 

75. PP  11.70 

75.011  11.70 


SIBILATION 

VOICED 

UNVOICED 


05.0S  3. 40 

■vi  .67  5.SP 

l'AP.PP  P.PP 


f.RAVENESS 

VOICED 

UNVOICED 


70.17  9. OP 

10P.PP  p.pp 
•>5,53  15, PP 


COMPACTNESS 

VOICFD 

UNVOICED 


1P5.5P  P.dP 
JUP.PB  p.pp 

JPP.Pp  P.PP 


TOTALS 


9(1.07  3.97 


A B S F m T 

MEAN  S.F, 

91.57  5.5P 

1PP.«*P  P.PP 

P.1.33  13.61 

1PP.PP  “.PP 

1PH‘.  I*A  P.PP 

1PP.PP  3.PP 

5«.57  13,51 

5 r*  ’.  0 P P3.57 

53.33  13.61 

IPP.pi*  P.PP 

lBp'.PP  P.PP 

1PP.PP  P.PB 

75. PP  5.50 

IP'I.P"  p.pp 

5 P P P U‘.70 

1 PP . 55  P.PO 

15P.PP  P.PP 

1 PCI  .BP  P'.  PP 

55,50  P.54 


TOTAL 


MEAN 

S.E. 

03.83 

3.4P 

1 PP.PP 

P.PP 

91  .37 

6.8P 

97.9? 

1.78 

93.83 

3.4P 

1 PP.PP 

P.PP 

7P.S3 

12.27 

5P.3P 

13.39 

70.17 

12.27 

07.9? 

1.78 

93.53 

3.40 

1 pp  , PP 

P.80 

77. P5 

4.3P 

1 an.PP 

P.00 

54.17 

9.88 

1«P.PP 

8 ’.88 

1PP.PP 

8,88 

1PP.PP 

P.P0 

59.03 

3.34 

• MEAN  a 60,03  * 

TOTAL  DOT  SCOPE  I * * 

• S.E'.  a 5.54  * 


K 
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SYSTEM  TESTED:  HoA  1 h«l)FC-77  PRPBT  1 


NUMBER  LISTENERS  « tl 
NMMFFR  SPEAKERS  ■ 3 


FOW  LISTENER:  0483  • 


sfk«  score 

BY  01.67 
Jt  0(*,A? 
RU  SO, 8? 


MAJN  ATTRIBUTE:  PRESENT  ABSENT  TOTAL 


MF  AN 

s.r. 

MEAN 

S.E. 

MEAN 

S.E. 

VOICING 

95. B3 

•V.  AO 

98.83 

3.4B 

95.83 

1.70 

FRICTIONAL 

IBP. OB 

0 , PM 

01.87 

6.8B 

95.83 

3.40 

NON-FRICTIONAl. 

91  .07 

6. SB 

1 PM .Op 

O.MP 

95,83 

3.40 

NASALITY 

IBP.  OP 

P.PP 

1 OP. PM 

B.PB 

1 MB  .MB 

0.00 

URAVE 

IMP. 00 

P.PM 

1P0.PP 

B'.BB 

IBM. MB 

0.00 

acutf 

IMP .«« 

P.PP 

IPP'.PM 

o.PB 

1BM.B0 

0.00 

SUSTENTION 

7S.P" 

IS'.PI 

79.17 

3.4B 

77.  MS 

4'.  50 

VOICED 

66.67 

1P.00 

75. PM 

11.79 

7M.B3 

6.80 

UNVOICED 

83.33 

1S.B1 

83.33 

6.8B 

83.33 

3.40 

SIBILATION 

OS.  PS 

3.40 

98.  P3 

3.40 

95.83 

1.70 

VOICED 

IMP.0M 

P.PP 

Ol'.«7 

6'.8P 

95.83 

3.40 

UNVOICEP 

B 1 ,P? 

6, BP 

lPM'.BP 

B.BP 

95.83 

3.40 

C.RAVFnESS 

70.17 

3.4P 

78. PP 

8.89 

77.08 

4.50 

VOICED 

l'/M.PB 

M ,»P 

JPM. PM 

P.BB 

1PB.M0 

0.00 

I'NVOICEP 

SB. S3 

P.PP 

8M.PP 

11.79 

54.17 

9,00 

COMPACTnF  ss 

100. BP 

M.PP 

IMP, BP 

P.PM 

1 OM  .MB 

0.00 

VOICfcO 

1 MP, PM 

P.PM 

1PB.MP 

M.Bfl 

1MB, 00 

0.00 

UNVOICED 

1 OP. PM 

P.PP 

tPB.BP 

P.BM 

100,00 

0,00 

TOTALS 

00.07 

2.P4 

9P.07 

2.27 

90.97 

0.28 

• MF  AN  ■ 

9P.97  • 

TOT  Al  OUT 

SCORE: 

• 

• 

• 3.E'.  » 

P.28  * 
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SV5TEM  TESTED  I 11P4  lfi-DEC-77  PROBF  1 


"NUMBER  l ISTENERS  ■ 11 
NUMBER  SPEAKFRS  ■ 3 


FOP  LISTENER!  9557  « 


SPKR  SCORE 

HV  80,58 
JE  P0.58 
PD  OP. 7J 


MAIN  ATTRIBUTE  1 

PRESENT 

ABSENT 

TOTAL 

MEAN 

S.E. 

MEAN 

S.E. 

MEAN 

S.E. 

VOICING 

IBP. HP 

p.pp 

83.33 

3,40 

01.87 

1.70 

FRICTIONAL 

1P0.PP 

* 

83'.  33 

5.80 

91  .57 

3.40 

non-frictional. 

lup ,pp 

9 

83.33 

6.80 

91  .87 

3.4P 

NASALITY 

1PP.PP 

P.fA 

1PP.PP 

P.PP 

1*0.00 

P.PP 

GRAVF 

1MP.PP 

P.PP 

IPP'.PP 

R'.PP 

1 PP.PB 

P.PP 

ACUTE 

1PP.PP 

*,AK 

IPP'.PP 

P'.PP 

1PP.PP 

P.PP 

SUSTENTION 

79.17 

9.0P 

88,87 

3.4P 

73.9? 

8.13 

VOICED 

SB.  S3 

18. PP 

88.33 

13.51 

58.33 

14.83 

UNVOICED 

MP.PP 

P.PP 

75. PP 

11.70 

87. 5P 

5.89 

sibilation 

01.87 

3.4P 

1PP.PP 

P.PP 

05.83 

1 ,7P 

VOICFO 

01.  «7 

B.PP 

1PP.PP 

P.PP 

95.83 

3.4P 

UNVOICED 

91,87 

8. BP 

1PP.P0 

P.PP 

95.83 

3. 40 

GRAVENESS 

70.17 

3.4P 

87.  ?P 

5.89 

83.33 

1.7P 

VOICED 

91  .87 

8,80 

1PP.PP 

P.PP 

95.83 

3.40 

UNVOICED 

68.87 

13. M 

75. P« 

11.70 

7R.83 

3.40 

COMPACTNESS 

IPP.PP 

P.PP 

1 pp.pp 

P.PP 

1PP.PP 

0.00 

VOICED 

1PP.0P 

P.PP 

1 PP . PP 

P.PP 

1 PP.PB 

0,00 

UNVOICED 

1 PP.PP 

P.PP 

1PP.PP 

n.pp 

1 00.00 

P.PP 

TOTALS 

01  .57 

?.B  P 

80,88 

P.08 

OP. 5? 

P .85 

*1 

* 

MF  AN  ■ 

9P.8?  • 

TOTAL  ort 

SCORE! 

* 

♦ 

* 

S.E.  ■ 

P.85  • 

P] 

ii 


SYSTEM  tested  I 11*4  16.0FC-77  PHDPE  1 


NIJMhFR  LISTENFPS  « 11 
NU*PF9  SPFAKF96  « 5 


FOP  SPEAKERS  JE  « 

LISTENER 

SCOPE 

1277 

*0.56 

3J45 

*0.20 

4076 

*V'.21 

5345 

*4.37 

54*6 

**.64 

5**4 

*7.6* 

6854 

?*.2i 

6068 

o*.«? 

03*9 

*7.6* 

0463 

02,69 

0567 

*0.5* 

MAT*  ATTPimmi 

-BSSS— " - 


XlCABIi® 


POF.SENT 


ABSENT 


TOTAL 


MFAK 

S.F. 

MEAN 

S.F. 

MEAN 

S.E. 

VOTCT'.'R 

06.46 

?.*? 

81  .*2 

3.36 

88.64 

1.35 

FRICTIONAL 

07.73 

2.17 

88.64 

3.75 

03.18 

1.68 

kiDM-FRICTION*! 

03.1* 

3.3* 

75.** 

5.57 

84,09 

2.83 

NASALITY 

1 « , n n 

*.** 

06,50 

1.68 

08.3* 

0.84 

GRAVE 

l:'P.** 

* ,** 

03.1* 

3.36 

96.59 

1.68 

ACUTE 

10P.22 

fi  .** 

1*™.0* 

*.** 

!*«.** 

0.00 

SUSTENTION 

*1  .3* 

4.04 

*1  .36 

4.67 

*1.36 

4.00 

VOICEP 

64.55 

5,4* 

25.** 

7.87 

39.77 

5.04 

I'NvoirEo 

6*. IP 

7.03 

07.73 

2.17 

82.05 

4,62 

SIPILATION 

70.66 

4.P0 

!**,** 

*.** 

89.77 

7.45 

VOICFD 

03.1* 

3.36 

1*1"'.** 

*.** 

06.59 

1.60 

UN'/OICfcO 

*6.01 

* ,*6 

1*3.*« 

*.*P 

67.05 

4.02 

GRAVFNFSS 

73.8* 

3.30 

6*. 64 

2.09 

*1.25 

2.54 

V0ICF0 

07.73 

7.17 

IP*’.** 

*.** 

06.88 

1.08 

UNVOICE* 

6*  . *2 

7. IP 

77.27 

5.97 

63. 6* 

4.94 

COHF  ACTNF5S 

1 011.0* 

*.** 

9*, *6 

1 .88 

00.43 

0.54 

VOICED 

l*o.nn 

*,** 

1**.** 

*.00 

1 0*,00 

0.00 

UNVOICED 

1**,** 

*,** 

97'.  73 

2.17 

98.66 

1.06 

TOTALS 

*5.04 

1.6* 

87  , *6 

*.08 

*6.46 

1.15 

0»T  SCOPE  1 


• MF  AW  ■ 

* 

• S.t.  » 


86,46 

1.15 


* 

* 

♦ 


TOT  41 


\ 


SYST6P  TF5T£ni  11*4  16-9FC-77  PHf'BF  1 

NUHFEK  LISTENERS  » U 
niimSFN  SPEAKERS  ■ ? 


FOB  SPF»*ER»  BV  * 

***** 


Listens  sco»e 


1277 

3345 

4076 

•5345 

5406 

8004 

8854 

8M86 

0339 

94*3 

9557 


89.58 

*8.84 

*8.54 

*7.80 

88.4* 

*9.5* 

**.54 

01.87 

*4.37 

01.*7 

*9.5* 


BBIS  PAGE  IS  BEST  QUALITY  PRACHCAB6S 
PROM  COPY  FURNISHED  lODDC  ..  


-U1N  *TTPIHUTE1 


VOICING 

FRICTIONAL 
non- FRICTIONAL 


MASALJ7Y 

C.OAVF 

ACOTt 

sustention 

VOlCtO 

IinvOICEP 

SIBILATION 

VOTCFP 

IiNvOICEO 

GRAVFNESS 

VOICF.P 

cnvOKEO 

cqmpactnf  ss 
voictn 
UNvOICtO 

TOTALS 


PRESENT 


absent 
S.F 


MEAN 

If.T.OP 
IMf.PO 
l '.'f  .fo 

97.7? 

97.73 

07.73 

89.3? 

45,45 

9?  . 1 8 

*8,84 

79.55 

07.73 

*1  .*P 
100.00 
83.84 

08.88 

10P.BI* 

97.73 

80.39 


S’.F'. 

o’.pp 

M.PP 

P.PP 

1.48 

7.17 

7.17 

?'.  7 7 
5.4P 
4.85 

2.57 

4.33 

7.17 

4>8 

8,00 

8.11 

1>" 

P.PP 

7.17 

8 ’.8? 


MEAN 

94.32 

88.84 

100-.00 

1 8" ,88 
188.00 
IPB’.PP 

81  ,38 
70.45 
57.77 

180.00 
100.00 
1 pof.0P 

77.73 
1 0 0 '.  0 0 
43.45 

100,00 
1 00,00 
1 0 0 0 0 

88.07 


7.47 
4.94 
* .00 

0.00 
0*.  00 
0.00 

3.39 

5.40 

2.17 

0.00 

0.00 

0.00 

7.70 
0.00 
5'.  40 

0,00 

0.00 

0'.00 

0,81 


TOTAL  OPT  SCORE* 


* MF AN  • 88,73  * 

. 

• S'.E.  » * 


TOTAL 


MEAN 

S.E. 

97.18 

94.32 

1 P0.00 

1.24 

7.47 

0.00 

08.86 

08.86 

98.86 

0.73 

1.08 

1.08 

85.34 

57.95 

77.73 

2.46 

3.3? 

0.70 

04.37 

89.77 

98.86 

1.2« 

2.17 

1.08 

77.27 

100.00 

54.33 

2.31 

0.00 

4.62 

09. 4S 
100.00 
98.86 

0.94 

0.00 

1.08 

88.73 

0.61 

if 
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8TRTEP  TFSTtni  IIP*  IS-DFC-77  PPPBE  1 

NUMBER  LISTENERS  ■ 11 
NlIMPpR  SPEAKERS  ■ a 


FOP  SPFAKtPJ  «n  • 


L I STFNFR  SCOPE 


1 277 

03. 73 

.1J4J 

03. 7S 

4P?S 

02.71 

3343 

04.70 

54p6 

OP. 82 

sa?  4 

OS. S3 

St)S4 

02.71 

APSIS 

01  .07 

0039 

07.0? 

94  A3 

on. 82 

05S7 

02.71 

lllh  ATTRIBUTE:  PRESENT  ABSENT  TOTAL 


"Fan 

s.t*. 

MEAN 

S.E. 

MEAN 

S.E. 

voir imr 

lao. op 

«.pp 

04.32 

2.05 

07.15 

1.47 

FRICTIONAL 

l rtr>  .pp 

p.pp 

o«.9i 

4.85 

95.43 

2.42 

MIN-fPIfTTOMAl 

l'*t*.»p 

O.PP 

07.73 

2.17 

90.06 

1.08 

nASALITv 

IPa.po 

a .no 

ipp.no 

0.00 

100.00 

0.00 

grave 

l'*p,oa 

p.pp 

mo. on 

0.00 

100.00 

0.00 

ACI'TF 

1 'IP  . P 0 

p.pp 

inn '.no 

0.00 

100.00 

0.00 

S'JSTF*'Tinw 

OS. 45 

2.4? 

77.27 

3.08 
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SY5TFM  TFSTEOI  11  84  16-OFC-77  PROBE  1 


NUMBER  LISTENERS  • 11 
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SVSTE*  1104  16-0EC-77  PROBE  l 
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Dl.  INTRODUCTION 


The  purpose  of  this  report  is  to  review  the  behavioral  aspects  of  handling  lis- 
teners for  an  in-house  evaluation  capability  of  the  Diagnostic  Rhyme  Test. 

The  Diagnostic  Rhyme  Test  (DRT)  uses  a group  of  trained  listeners  involved  in 
a speech  discrimination  task.  The  test  is  designed  to  compare  speech  intelligibility 
between  voice  communication  systems;  digital  voice  processers  in  this  case.  The 
comparison  is  based  upon  the  listeners'  reception,  recognition,  association,  and 
response  of  the  processed  stimulus.  Since  the  validity  of  the  DRT  depends  on  human 

i 

behavioral  processes,  which  are  variable  from  one  listener  subject  to  the  next,  the 

use  of  test  controls  to  minimize  these  individual  variables  should  improve  the  con-  j 

sistency  and  reliability  of  test  results.  j 

The  test  controls  covered  in  this  report  will  include  the  experimental  effects  | 

of  the  test  situation.  Experimental  effects  are  the  sum  of  variables  introduced  into  f 
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the  test  situation  by  the  test  administrator,  the  test  subjects,  and  the  test  environ- 
ment itself,  A brief  section  on  listener  selection  and  preparation  will  be  included 
also.  Continued  research  is  needed  in  the  areas  of  listener  training  and  perform- 
ance tracking  to  improve  the  control  of  consistent  results.  The  report  will  close 
with  conclusions  and  recommendations  on  the  handling  of  listeners  for  in-house 
DRT  evaluations. 


1)2.  EXPERIMENTAL  EFFECTS 

As  mentioned  previously,  experimental  effects  are  the  summation  of  all  the 
outside  variables  contributed  by  the  test  administrator,  subjects,  and  environment 
which  contribute  to  t he  biasing  of  the  test  results.  Ideally,  a test  should  measure 
only  those  characteristics  intended  to  be  measured.  Differences  among  individuals 
and  environments  however,  can  influence  and  alter  test  results.  If  controls  can  be 

planed  upon  (tip  (pst  situation,  experimental  nr  test  efforts  can  bp  minimiaeri, 

D2.1  Administrator  Effects 

From  research  in  experimental  design  and  testing,  Rosenthal^  concludes  that 
a variety  of  biosocial,  psychosocial  and  social  psychological  factors  which  interact 
between  the  test  administrator  and  his  subjects  can  effect  the  subjects'  behavior 
and  response.  Physical  characteristics  such  as  age,  sex,  race,  etc.  and  personality 
characteristics  such  as  anxiety,  hostility,  warmth,  dominance,  etc.  can  alter  the 
way  a subject  responds  to  the  administrator  and  the  test  itself.  The  nature  of  the 
DRT  however,  tends  to  minimize  administrator  effects.  After  the  initial  training 
period,  the  listener  subjects  know  how  the  test  is  administered  and  what  the  admin- 
istrator expects  of  them.  When  a series  of  DRTs  are  being  conducted,  only  one 
administrator  should  give  the  test.  It  is  possible  that  listener  responses  could  be 
influenced  by  a change  of  test  administrators  in  a test. 

The  test  administrator  can  influence  subjects  very  easily  in  the  instructions  he 
gives  them,  according  to  Rosenthal  He  also  points  out  that  a test  of  simple  data 
collection  can  be  biased  by  the  experimentor  or  administrator.  * The  administrator 
must  be  careful  not  to  tell  the  listeners  anything  which  could  influence  their  re- 
sponses. Voiers  said  that  the  listeners  should  not  be  told  their  test  scores  or  should 

2 

never  be  told  to  try  harder  on  one  test  than  others.  Listeners  should  not  be  told 
how  many  tests  are  left  in  a series  or  how  much  longer  they  have  until  the  end  of 
a test.  The  administrator  should  never  give  a subject  any  doubt  that  he  may  fail  to 
be  a good  listener  or  that  he  —ill  be  removed  from  the  program  if  he  cannot 

1.  ""'"Rosenthal,  R,  (1966)  Experimental  Effects  in  Behavioral  Research,  Appleton- 

Century -Crofts,  New  York. 

2.  Interview  with  W.  D.  Voiers  on  28  Sept  1976  at  Dynastat,  Austin,  Texas. 
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perform  adequately.  Any  such  instructions  could  influence  a listener's  motivation 
or  attention  and  cause  inconsistent,  and  thus,  unreliable  performance. 

The  best  method  to  control  administrator  effects  is  to  develop  and  use  standard- 
ized procedures  for  the  administration  of  the  DRT. 

f)2.2  Environmental  Effect* 

Environmental  effects  are  all  physical  variables  present  in  the  test  situation 
which  can  affect  a subject's  response.  Environmental  effects  include  the  comfort- 
ability  of  the  test  room,  temperature,  lighting,  quietness  distractions,  etc.  A 
change  in  one  of  these  variables  can  decrease  a subject's  attention  to  the  task  and 
affect  the  subject's  response. 

If  the  environment  is  kept  constant,  the  listener  will  know  what  to  expect  and  will  be 
able  to  keep  his  attention  focused  on  listening.  Before  the  test  starts,  the  administrator 
should  insure  that  the  shades  are  down  in  the  test  room,  the  partitions  between  the  booths 
are  drawn,  distractions  are  removed  from  the  room,  headphones  work  properly,  vol- 
ume is  adjusted  comfortably,  room  temperature  is  comfortable,  and  that  listeners  are 

3 

supplied  with  the  necessary  pens  and  answer  sheets.  Voiers  says  the  DRT  is  insen- 
sitive to  volume  level  but  he  uses  an  average  vowel  peak  level  of  80  dbSPL  in  his  tests. 
Comfortable  room  temperature  for  working  is  between  70  and  74  degrees.  Precau- 
tions should  be  taken  to  insure  that  all  test  booklets  are  complete.  Speaker  tapes 
should  be  introduced  and  started  the  same  way  so  the  listeners  are  not  taken  by  surprise 
when  the  tape  begins.  With  the  presentation  of  all  the  testsstandardized,  the  listeners 
will  not  have  to  worry  about  distractions  which  would  influence  their  attention  and  response. 

1)2.3  Sul>ject/I.i*lcncr  Effect* 

Subject  effects  can  be  the  most  variable  of  the  three  effects  in  a test  situation. 
Personality  differences  among  individuals  cause  them  to  respond  differently  in  the 
test  situation.  The  number  of  speakers  and  listeners  in  the  DRT  tend  to  minimize 
listener  effects.  Controls  on  listeners'  motivation,  attention,  and  expectancies 
should  increase  test  reliability  although  studies  have  not  been  performed  to  support 
this  hypothesis. 

Listeners'  motivation  and  attention  will  be  discussed  as  part  of  listener  effects. 
Rosenthal1  proposes  that  individuals  who  volunteer  for  studies  have  three  aims  or 
motives  which  vary  among  individuals.  These  aims  will  also  be  discussed  in  this 
section  regarding  their  impact  on  listener  effects. 


Voiers,  W.  D.  (1967)  Performance  Evaluation  of  Speech  Processing  Devices,  III. 
Diagnostic  Evaluation  of  Speech  Intelligibility,  F inal  Report,  Contract 
No.  AF19(B2a)4!)H7". ' 
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1)2.4  Motivation 

Individuals  must  bo  properly  motivated  to  do  a task  or  they  wilt  not  do  it  well. 
Subjects  can  find  hnth  extrinsic  and  intrinsic  motivation  in  a task  like  the  DRT 
listener  program.  Extrinsic  motivation  includes  pay  or  recognition.  For  example, 
letters  of  appreciation  can  be  sent  to  the  listeners'  supervisors.  Intrinsic  rewards 
derive  from  a personal  sense  of  satisfaction,  accomplishment,  or  providing  a use- 
ful service.  Past  volunteer  listeners  have  expressed  a feeling  of  high  self-satis- 
faction in  participating  in  the  program.  Motivation  should  not  be  a problem  in  the 
in-house  DRT  program. 

1)2.5  Atli-nlkm 

Span  of  attention  can  vary  from  one  listener  to  the  next.  Listeners  should 

understand  that  they  should  try  to  pay  an  equal  amount  of  attention  throughout  tests. 

Listeners  who  try  harder  on  some  tests  than  others  will  vield  inconsistent  results. 

4 

Attention  is  largely  a variable  of  time.  Swets  and  Kristofferson  point  out  that 

there  are  conflicting  opinions  as  to  the  decrement  of  word  identification  performance 

5 

vs  time.  Baker  says  that  the  "auditory  sense  is  relatively  slow  to  fatigue". 

g 

Woodworth  and  Sehlosberg  found  that  subjects  may  experience  "blocks"  in  a 
mental  task.  Mocks  are  defined  as  a person’s  momentary  inability  lo  focus  atten- 
tion. They  are  involuntary  rest  periods  which  delay  the  onset  of  fatigue.  Rest 
periods  should  be  used  in  a test  to  prevent  blocks  from  occurring  since  they  could 
cause  unwanted  variations  in  test  performance. 

Yoiers  uses  two  groups  of  listeners  and  alternates  the  groups  in  20 -min  work/ 

20  min  rest  periods  for  his  DRT  listeners,  fie  uses  3 to  4 -hr  sessions. 

In-house  studies  have  shown  that  sets  of  20  min  work/ 10  min  rest/20  min  work 
periods  are  moat  efficient  for  test  with  one  group  of  listeners.  A minimum  of  at 
least  15  min  break  should  be  given  between  these  sets. 

1)2.6  Tlirer  Aim*  of  Tc*l  Subjects 

As  was  mentioned  in  the  introduction  of  this  section  of  the  report,  Rosenthal 
suggests  that  there  are  three  reasons  or  aims  of  people  who  volunteer  for  studies 
or  tests.  * These  three  aims  are  related  to  subject  effects  upon  a test.  These  aims 
should  be  satisfied  to  minimize  the  individuals'  effects  upon  the  test. 


4.  Swets,  J.A.,  and  Kristofferson,  A.B.  (1970)  Attention,  Annual  Review  of 

Psychology,  ,21:339-366. 

5.  Baker,  L.  M.  (1960)  General  Experimental  Psychology,  Oxford  University  Press, 

New  York. 

6.  Woodworth,  R.J.,  and  Scholsberg,  H.  ( 1965)  Experimental  Psychology  revised. 

Holt,  Rinehart  and  Winston,  Inc. , New  York. 
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First,  test  subjects  expect  to  receive  a reward  for  participating  in  the  study. 
The  different  types  of  extrinsic  and  intrinsic  rewards  and  their  effects  have  been 
discussed  previously  under  the  topic  of  subject  motivation. 

Second,  test  subjects  are  usually  interested  in  discovering  the  rationale  behind 
the  test.  In  some  studies,  the  administrator  does  not  want  the  subjects  to  know 

o 

what  they  are  being  tested  on,  so  he  uses  a blind;  a false  front  for  the  test.  Voters 
says  that  familiarity  with  the  DRT  does  not  affect  the  test.  To  satisfy  the  listeners' 
interest  in  discovering  the  rationale  of  the  test,  give  them  a brief  explanation  of 
the  purpose  of  the  DRT.  A summary  of  voice  proccssers  and  how  the  DRT  is  used 
to  evaluate  intelligibility  should  satisfy  the  listeners'  curiosity  and  may  even  develop 
in  them  more  interest  in  the  program. 

The  third  aim  of  a subject  in  a test  is  to  represent  himself  in  a favorable  light 
to  the  administrator.  Subjects  are  usually  curious  about  their  performance.  Voiers 
does  not  give  the  test  results  to  his  listeners  since  it  could  bias  later  responses. 
Subjects  also  try  to  conform  to  the  expectations  of  the  experimentor,  which  could 
lead  to  biasing  through  experimentor  effects  if  the  administrator  is  not  careful.  To 
solve  this  problem  for  the  listeners,  the  administrator  should  encourage  the  lis- 
teners by  recognizing  their  efforts.  He  can  assure  them  and  show  appreciation 
without  giving  them  the  test  results.  Rosenthal*  says  that  a "self-fulfilling 
prophecy"  works  on  test  subjects.  If  the  administrator  does  not  give  the  listeners 
any  reasons  why  they  would  fail  as  good  listeners,  and  assures  them  that  they  are 
performing  well,  they  should  not  worry  about  how  they  are  performing.  This,  in 
turn,  should  minimize  any  effects  due  to  the  listeners  doubting  their  performance. 


D3.  LISTENER  PREPARATION 

This  section  will  briefly  discuss  some  aspects  of  listener  selection  and  use  of 
listeners  in  the  DRT. 

Since  the  DRT  is  a speech  discrimination  task,  subjects  must  pass  certain 

hearing  tests  before  they  can  become  listeners  in  the  program.  First,  the  subject 

must  have  normal  hearing  as  determined  by  an  audiometer  test.  Voiers  uses  a 

7 

range  of  250  to  8000  Hz.  Second,  the  subject  must  be  able  to  discriminate  between 
the  present  and  absent  states  of  all  six  voice  attributes.  Voiers  et  al  found  that 

g 

hearing  impairment  is  not  unidimensional  and  may  go  beyond  simple  tone  reception. 
Different  aspects  of  speech  discrimination  performance  are  affected  depending  on 

7.  Voiers,  W.  D.  (1969)  The  Effects  of  Masking  Voices  on  the  Apprehensibility  of 

Six  Consonant  Attributes,  Scientific  Report  No,  l,  A FCTTTj  Contract  No. 

A F 19(628 1 -5883. 

8.  Voiers,  W.  D, , Sharpley,  A.  D. , and  Hehmsoth,  C.  J.  (1973)  Research  on 

Diagnostic  Evaluation  of  Speech  Intelligibility,  Final  Report,  AFCRL  Contract 
No.  F10ti2«-70-l'-01M2. — 
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the  degree  anti  nature  of  the  hearing  impairment.  This  aspect  of  hearing  Impairment 
can  be  determined  by  cheeking  the  performance  of  trainee  listeners  over  a control 
DRT  tape.  Performance  in  each  voice  attribute  should  level  out  after  a period  of 
practice.  Erratic  performance  on  any  attribute  would  indicate  a hearing  impair- 
ment in  that  individual  and  he  should  not  be  used  as  a listener.  Further  tests  need 
to  be  performed  in  this  area  however,  since  it  is  unknown  how  long  it  take3  the 
average  listener  to  find  a consistent  level  of  performance  in  all  attributes.  Answers 
to  this  question  would  define  the  training  period  for  new  listeners  and  would  dis- 
criminate between  good  and  bad  listeners. 

After  a pool  of  listeners  is  established  and  you  are  ready  to  test,  trained 
listeners  need  a warm-up  test  before  each  session  of  DRTs.  Voiers  says  two 

3 

speaker  lists  prove  enough  warm-up  to  get  the  listeners  reaccustomed  to  the  DRT. 
In-house  tests  have  supported  this  finding.  The  warm-up  lists  should  not  be  the 
same  lists  which  are  to  be  evaluated  in  the  test. 

During  each  DRT  session,  each  listener  should  be  tested  to  make  sure  he  is 
performing  satisfactorily.  Responses  from  a listener  who  is  under  emotional  stress, 
tired,  etc.  during  one  session  will  differ  from  his  normal  performance.  If  this 
occurs,  the  listeners'  results  should  not  be  used  in  that  evaluation.  Since  eight 
listeners  are  used  in  the  DRT,  ten  listeners  should  be  tested  to  allow  for  two  sets 
of  results  to  be  discarded  for  the  proceeding  reason.  A control  tape,  played  once 
each  session,  can  be  used  to  track  the  listeners'  performance  for  that  day  and 
compare  it  to  their  standard  performance.  Research  is  necessary  in  this  area  to 
establish  criteria  on  acceptable  performance  limits  for  listeners. 


1)4.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  DRT  is  designed  so  as  to  minimize  ■'xperimental  effects.  The  precautions 
suggested  previously  in  this  report,  are  an  aid  to  insure  experimental  effects  are 
minimized.  The  test  administrator  should  be  aware  of  the  influence  he  has  on  a 
test,  even  the  DRT.  The  environment  should  be  kept  comfortable  and  free  of 
changes.  After  the  training  period,  the  listeners  should  settle  into  a comfortable 
understanding  and  consistency  in  taking  the  DRT.  Therefore,  very  little  in  the 
way  of  recommendations  on  a standard  set  of  instructions  can  be  given  to  the 
listeners  every  time  they  come  to  take  the  test.  They  will  know  what  their  job  is. 
All  the  administrator  need  do  is  remind  them  to  pay  consistent  attention  and  how 
to  score  the  answer  sheet.  They  should  become  familiarized  enough  not  to  require 
detailed  instructions  for  every  session. 

There  are  only  two  major  areas  that  need  refining  to  better  implement  the 
in-house  DRT  evaluation.  The  first  area  involves  the  discrimination  between  good 


and  bad  listeners.  A good  listener  is  a consistent  scorer.  An  inconsistent 
listener  can  not  be  used  in  the  DRT  program.  A statistical  test  to  define  the  limits 
of  consistency  has  not  been  developed  as  of  yet.  Once  criteria  have  been  developed, 
the  bad  listeners  can  be  identified  and  a pool  of  good  listeners  can  be  established 
for  use  in  the  in-house  program. 

The  second  area  of  research  involves  the  tracking  of  listener  performance. 

Once  again,  statistical  tests  have  yet  to  be  developed  to  record  the  on-going 
performance  of  the  established  listener  pool.  A statistical  test  to  establish  con- 
fidence intervals  for  each  individual's  performance  must  be  developed  to  validate 
each  listeners'  performance  during  each  OUT. 

Once  statistical  tests  to  discriminate  between  consistent  and  inconsistent 
listeners  and  statistical  tests  to  track  each  individual's  performance  are  developed, 
the  in-house  capabilities  for  tne  PUT  should  he  sufficient  to  conduc'  reliable  testing. 
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